Sep 01 23:47:28 devstack cinder-volume[75587]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 23:47:28 devstack cinder-volume[75587]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 23:47:28 devstack cinder-volume[75587]: we strongly recommend against using it for new projects. Sep 01 23:47:28 devstack cinder-volume[75587]: If you are already using Eventlet, we recommend migrating to a different Sep 01 23:47:28 devstack cinder-volume[75587]: framework. For more detail see Sep 01 23:47:28 devstack cinder-volume[75587]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 23:47:28 devstack cinder-volume[75587]: import eventlet # noqa Sep 01 23:47:30 devstack cinder-volume[75587]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 23:47:30 devstack cinder-volume[75587]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 23:47:30 devstack cinder-volume[75587]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 23:47:31 devstack cinder-volume[75587]: INFO dbcounter [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Registered counter for database cinder Sep 01 23:47:31 devstack cinder-volume[75587]: DEBUG oslo_db.sqlalchemy.engines [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:47:31 devstack cinder-volume[75587]: DEBUG dbcounter [-] [75587] Writer thread running {{(pid=75587) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 23:47:31 devstack cinder-volume[75587]: INFO cinder.rpc [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 23:47:31 devstack cinder-volume[75587]: INFO cinder.rpc [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_db.sqlalchemy.engines [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:47:32 devstack cinder-volume[75587]: INFO cinder.volume.manager [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Determined volume DB was empty at startup. Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG cinder.volume.manager [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75587) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 23:47:32 devstack cinder-volume[75587]: INFO cinder.volume.manager [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 23:47:32 devstack cinder-volume[75587]: WARNING stevedore.named [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 23:47:32 devstack cinder-volume[75587]: WARNING castellan.key_manager [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 23:47:32 devstack cinder-volume[75587]: WARNING cinder.keymgr.conf_key_mgr [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG cinder.volume.drivers.lvm [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75587) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_concurrency.processutils [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75587) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_concurrency.processutils [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] CMD "cinder-rtstool verify" returned: 0 in 0.484s {{(pid=75587) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_db.sqlalchemy.engines [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:47:32 devstack cinder-volume[75587]: INFO cinder.rpc [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 23:47:32 devstack cinder-volume[75587]: INFO cinder.rpc [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 23:47:32 devstack cinder-volume[75587]: WARNING stevedore.named [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 23:47:32 devstack cinder-volume[75587]: WARNING castellan.key_manager [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 23:47:32 devstack cinder-volume[75587]: INFO cinder.volume.manager [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_db.sqlalchemy.engines [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:47:32 devstack cinder-volume[75587]: INFO oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Starting 1 workers Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Started child 75746 {{(pid=75587) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Full set of CONF: {{(pid=75587) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] ******************************************************************************** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Configuration options gathered from: {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] ================================================================================ {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] allow_availability_zone_fallback = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] allow_compression_on_image_upload = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] allowed_direct_url_schemes = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] api_rate_limit = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] auth_strategy = keystone {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] az_cache_duration = 3600 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75746]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_availability_zone = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_host = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_stats_polling_interval = 60 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backup_api_class = cinder.backup.api.API {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backup_name_template = backup-%s {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backup_use_same_host = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backup_use_temp_snapshot = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] chap_password = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] chap_username = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cinder_internal_tenant_project_id = 93988c8a8ba34a46bcaded4a3fd898a8 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cinder_internal_tenant_user_id = 67e51bbb83e546c8a113252c6808f8bb {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cloned_volume_same_az = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cluster = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] compression_format = gzip {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] compute_api_class = cinder.compute.nova.API {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] config_dir = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] config_source = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] control_exchange = openstack {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] debug = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] default_availability_zone = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] default_group_type = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] default_volume_type = lvmdriver-1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] disk_geometry = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] driver_client_cert = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] driver_client_cert_key = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] driver_data_namespace = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] driver_ssl_cert_path = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] driver_ssl_cert_verify = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] driver_use_ssl = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] enable_force_upload = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] enable_new_services = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] enable_unsupported_driver = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] enforce_multipath_for_image_xfer = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] filter_function = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_api_insecure = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_api_servers = ['http://192.168.122.58/image'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_api_ssl_compression = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_ca_certificates_file = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_catalog_info = image:glance:publicURL {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_certfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_keyfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_num_retries = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance_request_timeout = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] goodness_function = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] graceful_shutdown_timeout = 5 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] group_api_class = cinder.group.api.API {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] host = devstack {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_compress_on_upload = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_conversion_address_space_limit = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_conversion_cpu_limit = 60 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_conversion_disable = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_upload_use_cinder_backend = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_upload_use_internal_tenant = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_volume_cache_enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_volume_cache_max_count = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] image_volume_cache_max_size_gb = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] init_host_max_objects_retrieval = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] instance_format = [instance: %(uuid)s] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] iscsi_target_flags = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] iscsi_write_cache = on {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] iser_helper = tgtadm {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] iser_ip_address = 192.168.122.58 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] iser_port = 3260 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] log_color = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] log_config_append = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] log_dir = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] log_file = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] log_options = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] log_rotate_interval = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] log_rotate_interval_type = days {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] log_rotation_type = none {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] max_age = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] max_logfile_count = 30 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] max_logfile_size_mb = 200 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] max_over_subscription_ratio = 20.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] message_reap_interval = 86400 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] message_ttl = 2592000 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] migration_create_volume_timeout_secs = 300 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] monkey_patch = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] monkey_patch_modules = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] my_ip = 192.168.122.58 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] no_snapshot_gb_quota = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] num_iser_scan_tries = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] num_shell_tries = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] num_volume_device_scan_tries = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] nvmeof_conn_info_version = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] nvmet_ns_id = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] nvmet_port_id = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] osapi_max_limit = 1000 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] osapi_volume_ext_list = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] osapi_volume_listen_port = 8776 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] osapi_volume_use_ssl = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] osapi_volume_workers = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] per_volume_size_limit = -1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] periodic_fuzzy_delay = 60 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] periodic_interval = 60 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] public_endpoint = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] publish_errors = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] quota_backup_gigabytes = 1000 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] quota_backups = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] quota_gigabytes = 1000 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] quota_groups = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] quota_snapshots = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] quota_volumes = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] rate_limit_burst = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] rate_limit_except_level = CRITICAL {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75746]: INFO cinder.volume.manager [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 23:47:32 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] rate_limit_interval = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] reinit_driver_count = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] replication_device = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] report_discard_supported = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] report_interval = 120 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] reservation_clean_interval = 86400 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] reservation_expire = 86400 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] reserved_image_namespaces = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] reserved_percentage = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] rpc_response_timeout = 120 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] run_external_periodic_tasks = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] scst_target_driver = iscsi {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] scst_target_iqn_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_down_time = 720 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] shell_completion = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] snapshot_name_template = snapshot-%s {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] snapshot_same_host = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] split_loggers = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] state_path = /opt/stack/data/cinder {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] storage_availability_zone = nova {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] storage_protocol = iSCSI {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] syslog_log_facility = LOG_USER {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] target_helper = lioadm {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] target_ip_address = 192.168.122.58 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] target_port = 3260 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] target_protocol = iscsi {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] target_secondary_ip_addresses = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] trace_flags = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] transport_url = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] until_refresh = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] use_chap_auth = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] use_default_quota_class = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] use_journal = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] use_json = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] use_multipath_for_image_xfer = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] use_stderr = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] use_syslog = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] verify_glance_signatures = enabled {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_api_class = cinder.volume.api.API {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_backend_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_clear = zero {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_clear_ionice = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_clear_size = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_copy_bps_limit = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_dd_blocksize = 1M {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_name_template = volume-%s {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_service_inithost_offload = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volume_usage_audit_period = month {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] zoning_mode = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_concurrency.disable_process_locking = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.auth_section = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.auth_type = password {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.auth_version = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.cache = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.certfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.include_service_catalog = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.insecure = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.interface = public {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.keyfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_password = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcache_username = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.region_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.service_type = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.58/identity {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.backend = dogpile.cache.null {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.backend_argument = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.backend_expiration_time = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.config_prefix = cache.oslo {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.debug_cache_backend = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.enable_retry_client = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.enable_socket_keepalive = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.expiration_time = 600 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.hashclient_retry_attempts = 2 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.memcache_dead_retry = 300 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.memcache_pool_maxsize = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.memcache_sasl_enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.password = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.proxies = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.redis_db = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.redis_server = localhost:6379 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.retry_attempts = 2 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.retry_delay = 0.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.socket_keepalive_count = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.socket_keepalive_idle = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.socket_keepalive_interval = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.socket_timeout = 1.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.tls_allowed_ciphers = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.tls_cafile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.tls_certfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:32 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.tls_enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.tls_keyfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cache.username = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] coordination.backend_url = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.asyncio_connection = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.asyncio_slave_connection = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.backend = sqlalchemy {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.connection = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.connection_debug = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.connection_parameters = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.connection_recycle_time = 3600 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.connection_trace = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.db_inc_retry_interval = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.db_max_retries = 20 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.db_max_retry_interval = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.db_retry_interval = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.max_overflow = 50 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.max_pool_size = 5 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.max_retries = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.mysql_wsrep_sync_wait = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.pool_timeout = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.retry_interval = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.slave_connection = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.sqlite_synchronous = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.synchronous_reader = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] database.use_db_reconnect = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_tracing.insecure = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.connection_string = messaging:// {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.es_doc_type = notification {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.es_scroll_size = 10000 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.es_scroll_time = 2m {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.filter_error_trace = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.hmac_keys = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.sentinel_service_name = mymaster {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.socket_timeout = 0.1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.trace_requests = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler.trace_sqlalchemy = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler_jaeger.process_tags = {} {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler_jaeger.service_name_prefix = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] profiler_otlp.service_name_prefix = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.enforce_new_defaults = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.policy_default_rule = default {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack sudo[75750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 23:47:33 devstack sudo[75750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.policy_file = policy.yaml {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] privsep_osbrick.group = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] privsep_osbrick.helper_command = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] privsep_osbrick.user = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cinder_sys_admin.group = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cinder_sys_admin.helper_command = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] cinder_sys_admin.user = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.auth_section = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.auth_type = password {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.cafile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.certfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.collect_timing = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.insecure = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.keyfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.send_service_user_token = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.split_loggers = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.timeout = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.tls_ciphers = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] service_user.tls_min_version = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.auth_section = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.auth_type = password {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.certfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.collect_timing = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.insecure = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.keyfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.region_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.split_loggers = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.timeout = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.tls_ciphers = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] glance.tls_min_version = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.backend_availability_zone = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.chap_password = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.chap_username = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.disk_geometry = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.driver_client_cert = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.driver_client_cert_key = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.driver_data_namespace = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.driver_use_ssl = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.extra_capabilities = {} {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.filter_function = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.goodness_function = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.iscsi_target_flags = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.iscsi_write_cache = on {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.iser_helper = tgtadm {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.iser_ip_address = 192.168.122.58 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.iser_port = 3260 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.lvm_share_target = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.lvm_type = auto {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.num_shell_tries = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.replication_device = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.report_discard_supported = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.reserved_percentage = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.target_helper = tgtadm {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.target_ip_address = 192.168.122.58 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.target_port = 3260 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.target_protocol = iscsi {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.trace_flags = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.unique_fqdn_network = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.use_chap_auth = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volume_backend_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volume_clear = zero {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volume_clear_ionice = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volume_clear_size = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_reports.file_event_handler = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_reports.log_dir = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.backend_host = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.chap_password = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.chap_username = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.disk_geometry = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.driver_client_cert = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.extra_capabilities = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.filter_function = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.goodness_function = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.iser_helper = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.iser_ip_address = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.iser_port = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.lvm_share_target = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.lvm_type = auto {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.num_shell_tries = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.replication_device = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.report_discard_supported = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.reserved_percentage = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.scst_target_driver = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.storage_protocol = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.target_helper = lioadm {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.target_ip_address = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.target_port = 3260 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.trace_flags = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.use_chap_auth = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volume_clear = zero {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volume_clear_size = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] lvmdriver-1.volumes_dir = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.ssl = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_notifications.driver = [] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_notifications.retry = -1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] key_manager.fixed_key = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.barbican_api_version = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.barbican_endpoint = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.barbican_endpoint_type = public {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.barbican_region_name = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.cafile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.certfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.collect_timing = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.insecure = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.keyfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.number_of_retries = 60 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.retry_delay = 1 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.send_service_user_token = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.split_loggers = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.timeout = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.tls_ciphers = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.tls_min_version = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.verify_ssl = True {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican.verify_ssl_path = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.auth_section = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.auth_type = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.cafile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.certfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.collect_timing = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.insecure = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.keyfile = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.split_loggers = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.timeout = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.tls_ciphers = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] barbican_service_user.tls_min_version = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.approle_role_id = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.approle_secret_id = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.auth_method = approle {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.auth_path = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.kv_mountpoint = secret {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.kv_path = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.kv_version = 2 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.namespace = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.root_token_id = **** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.ssl_ca_crt_file = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.timeout = 60.0 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.token_file = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.token_role = None {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.use_ssl = False {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:47:33 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] ******************************************************************************** {{(pid=75587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 23:47:33 devstack sudo[75750]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:33 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.362s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:33 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:33 devstack sudo[75753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:47:33 devstack sudo[75753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:33 devstack sudo[75753]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:33 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.312s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:33 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 23:47:33 devstack cinder-volume[75746]: INFO cinder.brick.local_dev.lvm [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 23:47:33 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:33 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:33 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:33 devstack sudo[75815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:47:33 devstack sudo[75815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:33 devstack sudo[75815]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG cinder.brick.local_dev.lvm [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75746) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:34 devstack sudo[75925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:47:34 devstack sudo[75925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:34 devstack sudo[75925]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:34 devstack sudo[76116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:47:34 devstack sudo[76116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:34 devstack sudo[76116]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:34 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:34 devstack sudo[76215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 23:47:34 devstack sudo[76215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:35 devstack sudo[76215]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:35 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:35 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:35 devstack sudo[76291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:47:35 devstack sudo[76291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:35 devstack sudo[76291]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:35 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:35 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:35 devstack sudo[76369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:47:35 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:35 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:35 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:35 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:35 devstack sudo[76377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:47:35 devstack sudo[76377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:36 devstack sudo[76377]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:36 devstack sudo[76456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:47:36 devstack sudo[76456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:36 devstack sudo[76456]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:36 devstack sudo[76466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:47:36 devstack sudo[76466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:36 devstack sudo[76466]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:36 devstack cinder-volume[75746]: INFO cinder.volume.drivers.lvm [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:36 devstack sudo[76550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:47:36 devstack sudo[76550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:36 devstack sudo[76550]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG cinder.volume.drivers.lvm [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Updating volume stats {{(pid=75746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 23:47:36 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:36 devstack sudo[76553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:47:36 devstack sudo[76553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:37 devstack sudo[76553]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:37 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:37 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:37 devstack sudo[76556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:47:37 devstack sudo[76556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:37 devstack sudo[76556]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:37 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:37 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:37 devstack sudo[76559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:47:37 devstack sudo[76559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:37 devstack sudo[76559]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:37 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:37 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:37 devstack sudo[76562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:47:37 devstack sudo[76562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:37 devstack sudo[76562]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:37 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:37 devstack cinder-volume[75746]: INFO cinder.volume.driver [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 23:47:37 devstack cinder-volume[75746]: DEBUG cinder.volume.driver [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75746) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG oslo_db.sqlalchemy.engines [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG dbcounter [-] [75746] Writer thread running {{(pid=75746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG cinder.db.api [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Building query based on filter {{(pid=75746) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG cinder.image.image_utils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75746) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 23:47:38 devstack cinder-volume[75746]: INFO cinder.keymgr.migration [None req-0466ef4b-a35c-40f8-8aa6-ae654d545fe0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG cinder.volume.drivers.lvm [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Updating volume stats {{(pid=75746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:38 devstack sudo[76572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:47:38 devstack sudo[76572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:38 devstack sudo[76572]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:38 devstack sudo[76575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:47:38 devstack sudo[76575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:38 devstack sudo[76575]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:38 devstack sudo[76578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:47:38 devstack sudo[76578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:38 devstack sudo[76578]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:38 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:38 devstack sudo[76583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:47:38 devstack sudo[76583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:39 devstack sudo[76583]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG cinder.manager [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Notifying Schedulers of capabilities ... {{(pid=75746) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:47:39 devstack cinder-volume[75746]: INFO cinder.volume.manager [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Driver initialization completed successfully. Sep 01 23:47:39 devstack cinder-volume[75746]: INFO cinder.manager [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Initiating service 2 cleanup Sep 01 23:47:39 devstack cinder-volume[75746]: INFO cinder.manager [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Service 2 cleanup completed. Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG cinder.service [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Creating RPC server for service cinder-volume {{(pid=75746) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG cinder.service [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75746) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 23:47:39 devstack cinder-volume[75746]: INFO cinder.volume.manager [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG cinder.volume.drivers.lvm [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Updating volume stats {{(pid=75746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:39 devstack sudo[76586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:47:39 devstack sudo[76586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:39 devstack sudo[76586]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:39 devstack sudo[76589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:47:39 devstack sudo[76589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:39 devstack sudo[76589]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:39 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:39 devstack sudo[76593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:47:39 devstack sudo[76593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:40 devstack sudo[76593]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:40 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:40 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:47:40 devstack sudo[76598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:47:40 devstack sudo[76598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:47:40 devstack sudo[76598]: pam_unix(sudo:session): session closed for user root Sep 01 23:47:40 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:47:40 devstack cinder-volume[75746]: INFO cinder.volume.manager [None req-1b3576e0-90ca-4a3b-85a3-937cd7e48288 None None] Driver post RPC initialization completed successfully. Sep 01 23:47:42 devstack cinder-volume[75587]: DEBUG dbcounter [-] [75587] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75587) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:47:44 devstack cinder-volume[75746]: DEBUG oslo_service.periodic_task [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running periodic task VolumeManager._thread_info {{(pid=75746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:47:44 devstack cinder-volume[75746]: DEBUG cinder.volume.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] thread count: 6 {{(pid=75746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:47:44 devstack cinder-volume[75746]: DEBUG cinder.volume.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] thread info: [<_MainThread(MainThread, started 136924927316096)>, , , , , ] {{(pid=75746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:47:50 devstack cinder-volume[75746]: DEBUG dbcounter [-] [75746] Writing DB stats cinder:SELECT=4 {{(pid=75746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:47:50 devstack cinder-volume[75746]: DEBUG dbcounter [-] [75746] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:48:44 devstack cinder-volume[75746]: DEBUG oslo_service.periodic_task [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:48:44 devstack cinder-volume[75746]: DEBUG cinder.volume.drivers.lvm [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Updating volume stats {{(pid=75746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 23:48:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:48:44 devstack sudo[78652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:48:44 devstack sudo[78652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:48:44 devstack sudo[78652]: pam_unix(sudo:session): session closed for user root Sep 01 23:48:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:48:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:48:44 devstack sudo[78655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:48:44 devstack sudo[78655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:48:45 devstack sudo[78655]: pam_unix(sudo:session): session closed for user root Sep 01 23:48:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:48:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:48:45 devstack sudo[78658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:48:45 devstack sudo[78658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:48:45 devstack sudo[78658]: pam_unix(sudo:session): session closed for user root Sep 01 23:48:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:48:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:48:45 devstack sudo[78661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:48:45 devstack sudo[78661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:48:45 devstack sudo[78661]: pam_unix(sudo:session): session closed for user root Sep 01 23:48:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:48:45 devstack cinder-volume[75746]: DEBUG cinder.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Notifying Schedulers of capabilities ... {{(pid=75746) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:48:45 devstack cinder-volume[75746]: DEBUG oslo_service.periodic_task [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running periodic task VolumeManager._thread_info {{(pid=75746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:48:45 devstack cinder-volume[75746]: DEBUG cinder.volume.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] thread count: 6 {{(pid=75746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:48:45 devstack cinder-volume[75746]: DEBUG cinder.volume.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] thread info: [<_MainThread(MainThread, started 136924927316096)>, , , , , ] {{(pid=75746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:49:44 devstack cinder-volume[75746]: DEBUG oslo_service.periodic_task [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:49:44 devstack cinder-volume[75746]: DEBUG cinder.volume.drivers.lvm [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Updating volume stats {{(pid=75746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 23:49:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:49:44 devstack sudo[82031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:49:44 devstack sudo[82031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:49:44 devstack sudo[82031]: pam_unix(sudo:session): session closed for user root Sep 01 23:49:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:49:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:49:44 devstack sudo[82041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:49:44 devstack sudo[82041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:49:45 devstack sudo[82041]: pam_unix(sudo:session): session closed for user root Sep 01 23:49:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:49:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:49:45 devstack sudo[82044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:49:45 devstack sudo[82044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:49:45 devstack sudo[82044]: pam_unix(sudo:session): session closed for user root Sep 01 23:49:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:49:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:49:45 devstack sudo[82047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:49:45 devstack sudo[82047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:49:45 devstack sudo[82047]: pam_unix(sudo:session): session closed for user root Sep 01 23:49:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:49:45 devstack cinder-volume[75746]: DEBUG cinder.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Notifying Schedulers of capabilities ... {{(pid=75746) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:49:45 devstack cinder-volume[75746]: DEBUG oslo_service.periodic_task [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running periodic task VolumeManager._thread_info {{(pid=75746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:49:45 devstack cinder-volume[75746]: DEBUG cinder.volume.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] thread count: 6 {{(pid=75746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:49:45 devstack cinder-volume[75746]: DEBUG cinder.volume.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] thread info: [<_MainThread(MainThread, started 136924927316096)>, , , , , ] {{(pid=75746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:49:50 devstack cinder-volume[75746]: DEBUG dbcounter [-] [75746] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:50:44 devstack cinder-volume[75746]: DEBUG oslo_service.periodic_task [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:50:44 devstack cinder-volume[75746]: DEBUG cinder.volume.drivers.lvm [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Updating volume stats {{(pid=75746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 23:50:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:50:44 devstack sudo[84077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:50:44 devstack sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:50:44 devstack sudo[84077]: pam_unix(sudo:session): session closed for user root Sep 01 23:50:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:50:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:50:44 devstack sudo[84122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:50:44 devstack sudo[84122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:50:45 devstack sudo[84122]: pam_unix(sudo:session): session closed for user root Sep 01 23:50:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:50:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:50:45 devstack sudo[84155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:50:45 devstack sudo[84155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:50:45 devstack sudo[84155]: pam_unix(sudo:session): session closed for user root Sep 01 23:50:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:50:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:50:45 devstack sudo[84165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:50:45 devstack sudo[84165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:50:45 devstack sudo[84165]: pam_unix(sudo:session): session closed for user root Sep 01 23:50:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:50:45 devstack cinder-volume[75746]: DEBUG cinder.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Notifying Schedulers of capabilities ... {{(pid=75746) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:50:45 devstack cinder-volume[75746]: DEBUG oslo_service.periodic_task [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running periodic task VolumeManager._thread_info {{(pid=75746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:50:45 devstack cinder-volume[75746]: DEBUG cinder.volume.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] thread count: 6 {{(pid=75746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:50:45 devstack cinder-volume[75746]: DEBUG cinder.volume.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] thread info: [<_MainThread(MainThread, started 136924927316096)>, , , , , ] {{(pid=75746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:51:44 devstack cinder-volume[75746]: DEBUG oslo_service.periodic_task [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:51:44 devstack cinder-volume[75746]: DEBUG cinder.volume.drivers.lvm [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Updating volume stats {{(pid=75746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 23:51:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:51:44 devstack sudo[85373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 23:51:44 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:51:44 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root Sep 01 23:51:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:51:44 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:51:44 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:51:44 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:51:45 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Sep 01 23:51:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:51:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:51:45 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 23:51:45 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:51:45 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Sep 01 23:51:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:51:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:51:45 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 23:51:45 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:51:45 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Sep 01 23:51:45 devstack cinder-volume[75746]: DEBUG oslo_concurrency.processutils [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:51:45 devstack cinder-volume[75746]: DEBUG cinder.manager [None req-b6cfe9f5-9cac-4b59-97f5-a089e77335dc None None] Notifying Schedulers of capabilities ... {{(pid=75746) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:51:50 devstack cinder-volume[75746]: DEBUG dbcounter [-] [75746] Writing DB stats cinder:SELECT=1 {{(pid=75746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:51:50 devstack cinder-volume[75746]: DEBUG dbcounter [-] [75746] Writing DB stats cinder:UPDATE=1 {{(pid=75746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:51:54 devstack cinder-volume[75587]: INFO oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Caught SIGTERM, stopping children Sep 01 23:51:54 devstack cinder-volume[75587]: DEBUG oslo_concurrency.lockutils [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Acquiring lock "singleton_lock" {{(pid=75587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 23:51:54 devstack cinder-volume[75587]: DEBUG oslo_concurrency.lockutils [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Acquired lock "singleton_lock" {{(pid=75587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 23:51:54 devstack cinder-volume[75587]: DEBUG oslo_concurrency.lockutils [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Releasing lock "singleton_lock" {{(pid=75587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 23:51:54 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Stop services. {{(pid=75587) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 23:51:54 devstack cinder-volume[75587]: DEBUG oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Killing children. {{(pid=75587) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 23:51:54 devstack cinder-volume[75587]: INFO oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Waiting on 1 children to exit Sep 01 23:51:54 devstack cinder-volume[75746]: DEBUG oslo_concurrency.lockutils [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Acquiring lock "singleton_lock" {{(pid=75746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 23:51:54 devstack cinder-volume[75746]: DEBUG oslo_concurrency.lockutils [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Acquired lock "singleton_lock" {{(pid=75746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 23:51:54 devstack cinder-volume[75746]: DEBUG oslo_concurrency.lockutils [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Releasing lock "singleton_lock" {{(pid=75746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 23:51:54 devstack cinder-volume[75746]: WARNING amqp [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 23:51:54 devstack cinder-volume[75746]: WARNING amqp [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 23:51:54 devstack cinder-volume[75587]: INFO oslo_service.backend._eventlet.service [None req-4c275063-2ea7-4220-b89f-17d030b85400 None None] Child 75746 exited with status 0 Sep 01 23:51:54 devstack cinder-volume[85763]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 23:51:54 devstack cinder-volume[85763]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 23:51:54 devstack cinder-volume[85763]: we strongly recommend against using it for new projects. Sep 01 23:51:54 devstack cinder-volume[85763]: If you are already using Eventlet, we recommend migrating to a different Sep 01 23:51:54 devstack cinder-volume[85763]: framework. For more detail see Sep 01 23:51:54 devstack cinder-volume[85763]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 23:51:54 devstack cinder-volume[85763]: import eventlet # noqa Sep 01 23:51:56 devstack cinder-volume[85763]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 23:51:56 devstack cinder-volume[85763]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 23:51:56 devstack cinder-volume[85763]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 23:51:57 devstack cinder-volume[85763]: INFO dbcounter [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Registered counter for database cinder Sep 01 23:51:57 devstack cinder-volume[85763]: DEBUG oslo_db.sqlalchemy.engines [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:51:57 devstack cinder-volume[85763]: DEBUG dbcounter [-] [85763] Writer thread running {{(pid=85763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 23:51:57 devstack cinder-volume[85763]: INFO cinder.rpc [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 23:51:57 devstack cinder-volume[85763]: INFO cinder.rpc [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_db.sqlalchemy.engines [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:51:58 devstack cinder-volume[85763]: INFO cinder.volume.manager [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Determined volume DB was empty at startup. Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG cinder.volume.manager [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85763) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 23:51:58 devstack cinder-volume[85763]: INFO cinder.volume.manager [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 23:51:58 devstack cinder-volume[85763]: WARNING stevedore.named [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 23:51:58 devstack cinder-volume[85763]: WARNING castellan.key_manager [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 23:51:58 devstack cinder-volume[85763]: WARNING cinder.keymgr.conf_key_mgr [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 23:51:58 devstack cinder-volume[85763]: INFO cinder.volume.manager [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_db.sqlalchemy.engines [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:51:58 devstack cinder-volume[85763]: INFO oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Starting 1 workers Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Started child 85979 {{(pid=85763) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Full set of CONF: {{(pid=85763) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] ******************************************************************************** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Configuration options gathered from: {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] ================================================================================ {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] allow_availability_zone_fallback = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] allow_compression_on_image_upload = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] allowed_direct_url_schemes = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] api_rate_limit = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] auth_strategy = keystone {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_availability_zone = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_host = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85979]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_stats_polling_interval = 60 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backup_api_class = cinder.backup.api.API {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backup_name_template = backup-%s {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backup_use_same_host = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backup_use_temp_snapshot = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] chap_password = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] chap_username = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cinder_internal_tenant_project_id = 93988c8a8ba34a46bcaded4a3fd898a8 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cinder_internal_tenant_user_id = 67e51bbb83e546c8a113252c6808f8bb {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cluster = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] compression_format = gzip {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] compute_api_class = cinder.compute.nova.API {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] config_dir = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] config_source = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] control_exchange = openstack {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] debug = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] default_availability_zone = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] default_group_type = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] default_volume_type = QuobyteHD {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] disk_geometry = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] driver_client_cert = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] driver_client_cert_key = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] driver_data_namespace = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] driver_ssl_cert_path = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] driver_ssl_cert_verify = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] driver_use_ssl = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] enable_new_services = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] enable_unsupported_driver = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] enabled_backends = ['QuobyteHD'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] enforce_multipath_for_image_xfer = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] filter_function = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_api_insecure = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_api_servers = ['http://192.168.122.58/image'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_api_ssl_compression = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_ca_certificates_file = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_catalog_info = image:glance:publicURL {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_certfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_keyfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_num_retries = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance_request_timeout = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] goodness_function = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] graceful_shutdown_timeout = 5 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] group_api_class = cinder.group.api.API {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] host = devstack {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_compress_on_upload = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_conversion_address_space_limit = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_conversion_cpu_limit = 60 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_conversion_disable = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_upload_use_cinder_backend = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_upload_use_internal_tenant = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_volume_cache_enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_volume_cache_max_count = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] image_volume_cache_max_size_gb = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] init_host_max_objects_retrieval = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] instance_format = [instance: %(uuid)s] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] iscsi_target_flags = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] iscsi_write_cache = on {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] iser_helper = tgtadm {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] iser_ip_address = 192.168.122.58 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] iser_port = 3260 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] log_color = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] log_config_append = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] log_dir = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] log_file = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] log_options = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] log_rotate_interval = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] log_rotate_interval_type = days {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] log_rotation_type = none {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] max_age = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] max_logfile_count = 30 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] max_logfile_size_mb = 200 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85979]: INFO cinder.volume.manager [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 23:51:58 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.remotefs [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85979) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] max_over_subscription_ratio = 20.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] message_reap_interval = 86400 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] message_ttl = 2592000 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] migration_create_volume_timeout_secs = 300 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] monkey_patch = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] monkey_patch_modules = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] my_ip = 192.168.122.58 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] no_snapshot_gb_quota = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] num_iser_scan_tries = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] num_shell_tries = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] num_volume_device_scan_tries = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] nvmeof_conn_info_version = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] nvmet_ns_id = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] nvmet_port_id = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] osapi_max_limit = 1000 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] osapi_volume_ext_list = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] osapi_volume_listen = 0.0.0.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] osapi_volume_listen_port = 8776 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] osapi_volume_use_ssl = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] osapi_volume_workers = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] per_volume_size_limit = -1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] periodic_fuzzy_delay = 60 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] periodic_interval = 60 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] project_id_regex = [0-9a-f\-]+ {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] public_endpoint = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] publish_errors = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] quota_backup_gigabytes = 1000 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] quota_backups = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] quota_gigabytes = 1000 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] quota_groups = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] quota_snapshots = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] quota_volumes = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] rate_limit_burst = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] rate_limit_except_level = CRITICAL {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] rate_limit_interval = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] reinit_driver_count = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] replication_device = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] report_discard_supported = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] report_interval = 120 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] reservation_clean_interval = 86400 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] reservation_expire = 86400 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] reserved_image_namespaces = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] reserved_percentage = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] rpc_response_timeout = 120 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] run_external_periodic_tasks = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] scst_target_driver = iscsi {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] scst_target_iqn_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_down_time = 720 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] shell_completion = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] snapshot_name_template = snapshot-%s {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] split_loggers = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] state_path = /opt/stack/data/cinder {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] storage_availability_zone = nova {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] storage_protocol = iSCSI {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] syslog_log_facility = LOG_USER {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] target_helper = lioadm {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] target_ip_address = 192.168.122.58 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] target_port = 3260 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] target_protocol = iscsi {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] target_secondary_ip_addresses = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] trace_flags = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] transfer_api_class = cinder.transfer.api.API {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] transport_url = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] until_refresh = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] use_chap_auth = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] use_default_quota_class = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] use_journal = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] use_json = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] use_multipath_for_image_xfer = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] use_stderr = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] use_syslog = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] verify_glance_signatures = enabled {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_api_class = cinder.volume.api.API {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_backend_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_clear = zero {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_clear_ionice = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_clear_size = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_copy_bps_limit = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_dd_blocksize = 1M {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_name_template = volume-%s {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_service_inithost_offload = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volume_usage_audit_period = month {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] zoning_mode = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_concurrency.disable_process_locking = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.auth_section = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.auth_type = password {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.auth_version = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.cache = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.certfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.delay_auth_decision = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.http_connect_timeout = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.include_service_catalog = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.insecure = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.interface = public {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.keyfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_password = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcache_username = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.region_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.service_token_roles_required = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.service_type = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.token_cache_time = 300 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.58/identity {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.backend = dogpile.cache.null {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.backend_argument = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.backend_expiration_time = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.config_prefix = cache.oslo {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.debug_cache_backend = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.enable_retry_client = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.enable_socket_keepalive = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.expiration_time = 600 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.hashclient_retry_attempts = 2 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.memcache_dead_retry = 300 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.memcache_pool_maxsize = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.memcache_sasl_enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.password = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.proxies = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.redis_db = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.redis_sentinel_service_name = mymaster {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.redis_server = localhost:6379 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.retry_attempts = 2 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.retry_delay = 0.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.socket_keepalive_count = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.socket_keepalive_idle = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.socket_keepalive_interval = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.socket_timeout = 1.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.tls_allowed_ciphers = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.tls_cafile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.tls_certfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.tls_enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.tls_keyfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cache.username = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] coordination.backend_url = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.asyncio_connection = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.asyncio_slave_connection = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.backend = sqlalchemy {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.connection = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.connection_debug = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.connection_parameters = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.connection_recycle_time = 3600 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.connection_trace = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.db_inc_retry_interval = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.db_max_retries = 20 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.db_max_retry_interval = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.db_retry_interval = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.max_overflow = 50 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.max_pool_size = 5 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85979) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.max_retries = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85979]: WARNING cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85979]: WARNING cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.mysql_wsrep_sync_wait = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.pool_timeout = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.retry_interval = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.slave_connection = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.sqlite_synchronous = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.synchronous_reader = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] database.use_db_reconnect = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_tracing.insecure = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Running cmd (subprocess): mount.quobyte {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.connection_string = messaging:// {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.es_doc_type = notification {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.es_scroll_size = 10000 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.es_scroll_time = 2m {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.filter_error_trace = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.hmac_keys = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.sentinel_service_name = mymaster {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.socket_timeout = 0.1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.trace_requests = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler.trace_sqlalchemy = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler_jaeger.process_tags = {} {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler_jaeger.service_name_prefix = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] profiler_otlp.service_name_prefix = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.enforce_new_defaults = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.policy_default_rule = default {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.policy_file = policy.yaml {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_policy.remote_timeout = 60.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] privsep_osbrick.group = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] privsep_osbrick.helper_command = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] privsep_osbrick.user = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cinder_sys_admin.group = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cinder_sys_admin.helper_command = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] cinder_sys_admin.user = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.auth_section = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.auth_type = password {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.cafile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.certfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.collect_timing = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.insecure = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.keyfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.send_service_user_token = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.split_loggers = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.timeout = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.tls_ciphers = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] service_user.tls_min_version = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.auth_section = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.auth_type = password {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.certfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.collect_timing = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.insecure = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.keyfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.region_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.split_loggers = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.timeout = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.tls_ciphers = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] glance.tls_min_version = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.backend_availability_zone = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.chap_password = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.chap_username = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.disk_geometry = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.driver_client_cert = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.driver_client_cert_key = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.driver_data_namespace = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.driver_use_ssl = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.enable_unsupported_driver = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.extra_capabilities = {} {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.filter_function = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.goodness_function = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.iscsi_target_flags = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.iscsi_write_cache = on {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.iser_helper = tgtadm {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.iser_ip_address = 192.168.122.58 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.iser_port = 3260 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_host = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_login = admin {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_mount_options = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_password = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_private_key = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_share_path = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_ssh_port = 22 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.num_shell_tries = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.nvmet_port_id = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.quobyte_client_cfg = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.quobyte_volume_url = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.replication_device = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.report_discard_supported = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.reserved_percentage = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.scst_target_driver = iscsi {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.scst_target_iqn_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.storage_protocol = iSCSI {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.target_helper = tgtadm {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.target_ip_address = 192.168.122.58 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.target_port = 3260 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.target_protocol = iscsi {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.trace_flags = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.unique_fqdn_network = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.use_chap_auth = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.volume_backend_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.volume_clear = zero {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.volume_clear_ionice = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.volume_clear_size = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_reports.file_event_handler = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_reports.log_dir = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.backend_availability_zone = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.backend_host = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.chap_password = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.chap_username = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.chiscsi_conf = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.disk_geometry = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.driver_client_cert = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.driver_client_cert_key = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.driver_data_namespace = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.driver_use_ssl = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.extra_capabilities = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.filter_function = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.goodness_function = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.iscsi_target_flags = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.iscsi_write_cache = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:51:58 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=85979) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:51:58 devstack cinder-volume[85979]: INFO cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f ... Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.iser_helper = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed -c /etc/quobyte/client-cinder.cfg {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.iser_ip_address = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.iser_port = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.iser_target_prefix = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_host = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_login = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_mount_options = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_password = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_private_key = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_share_path = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_ssh_port = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.num_shell_tries = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nvmet_ns_id = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.nvmet_port_id = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.replication_device = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.report_discard_supported = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.reserved_percentage = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.scst_target_driver = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.storage_protocol = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.target_helper = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed -c /etc/quobyte/client-cinder.cfg Sep 01 23:51:58 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.target_ip_address = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.target_port = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.target_prefix = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.target_protocol = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.trace_flags = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.unique_fqdn_network = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.use_chap_auth = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.volume_clear = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.volume_clear_ionice = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.volume_clear_size = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] QuobyteHD.volumes_dir = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.ssl = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.ssl_version = {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_notifications.driver = [] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_notifications.retry = -1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] oslo_messaging_notifications.transport_url = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] key_manager.fixed_key = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.barbican_api_version = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.barbican_endpoint = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.barbican_endpoint_type = public {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.barbican_region_name = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.cafile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.certfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.collect_timing = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.insecure = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.keyfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.number_of_retries = 60 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.retry_delay = 1 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.send_service_user_token = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.split_loggers = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.timeout = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.tls_ciphers = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.tls_min_version = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.verify_ssl = True {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican.verify_ssl_path = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.auth_section = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.auth_type = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.cafile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.certfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.collect_timing = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.insecure = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.keyfile = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.split_loggers = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.timeout = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.tls_ciphers = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] barbican_service_user.tls_min_version = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.approle_role_id = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.approle_secret_id = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.auth_method = approle {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.auth_path = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.kv_mountpoint = secret {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.kv_path = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.kv_version = 2 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.namespace = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.root_token_id = **** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.ssl_ca_crt_file = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.timeout = 60.0 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.token_file = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.token_role = None {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.use_ssl = False {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:51:58 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] ******************************************************************************** {{(pid=85763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 23:51:59 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.416s {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:51:59 devstack cinder-volume[85979]: INFO cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f succeeded Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=85979) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.432s {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:51:59 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:51:59 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:51:59 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.237s {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:51:59 devstack cinder-volume[85979]: INFO cinder.volume.driver [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.volume.driver [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.936538696289, 'free_capacity_gb': 1773.936538696289, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85979) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_db.sqlalchemy.engines [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG dbcounter [-] [85979] Writer thread running {{(pid=85979) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.db.api [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Building query based on filter {{(pid=85979) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.image.image_utils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85979) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 23:51:59 devstack cinder-volume[85979]: INFO cinder.keymgr.migration [None req-f6f9f6b3-526c-4c9a-b343-2bcca77d8707 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=85979) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=85979) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:51:59 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:51:59 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:51:59 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.229s {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.manager [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Notifying Schedulers of capabilities ... {{(pid=85979) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:51:59 devstack cinder-volume[85979]: INFO cinder.volume.manager [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Driver initialization completed successfully. Sep 01 23:51:59 devstack cinder-volume[85979]: INFO cinder.manager [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Initiating service 3 cleanup Sep 01 23:51:59 devstack cinder-volume[85979]: INFO cinder.manager [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Service 3 cleanup completed. Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.service [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Creating RPC server for service cinder-volume {{(pid=85979) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.service [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85979) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 23:51:59 devstack cinder-volume[85979]: INFO cinder.volume.manager [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=85979) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.quobyte [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=85979) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:51:59 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:51:59 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:51:59 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:52:00 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Sep 01 23:52:00 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.342s {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:52:00 devstack cinder-volume[85979]: INFO cinder.volume.manager [None req-19d1151f-f5f7-499c-9791-e2d3da9d3004 None None] Driver post RPC initialization completed successfully. Sep 01 23:52:04 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-4b3119f1-ec85-4864-a28c-c6380ff15dfb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:52:04 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-4b3119f1-ec85-4864-a28c-c6380ff15dfb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:52:04 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.quobyte [None req-4b3119f1-ec85-4864-a28c-c6380ff15dfb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=85979) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:52:04 devstack cinder-volume[85979]: DEBUG cinder.volume.drivers.quobyte [None req-4b3119f1-ec85-4864-a28c-c6380ff15dfb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=85979) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:52:04 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-4b3119f1-ec85-4864-a28c-c6380ff15dfb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:52:04 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-4b3119f1-ec85-4864-a28c-c6380ff15dfb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:52:04 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:52:04 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:52:04 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Sep 01 23:52:04 devstack cinder-volume[85979]: DEBUG oslo_concurrency.processutils [None req-4b3119f1-ec85-4864-a28c-c6380ff15dfb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.246s {{(pid=85979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:52:04 devstack cinder-volume[85979]: DEBUG cinder.manager [None req-4b3119f1-ec85-4864-a28c-c6380ff15dfb None None] Notifying Schedulers of capabilities ... {{(pid=85979) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:52:07 devstack cinder-volume[85763]: INFO oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Caught SIGTERM, stopping children Sep 01 23:52:07 devstack cinder-volume[85763]: DEBUG oslo_concurrency.lockutils [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Acquiring lock "singleton_lock" {{(pid=85763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 23:52:07 devstack cinder-volume[85763]: DEBUG oslo_concurrency.lockutils [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Acquired lock "singleton_lock" {{(pid=85763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 23:52:07 devstack cinder-volume[85763]: DEBUG oslo_concurrency.lockutils [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Releasing lock "singleton_lock" {{(pid=85763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 23:52:07 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Stop services. {{(pid=85763) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 23:52:07 devstack cinder-volume[85763]: DEBUG oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Killing children. {{(pid=85763) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 23:52:07 devstack cinder-volume[85763]: INFO oslo_service.backend._eventlet.service [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Waiting on 1 children to exit Sep 01 23:52:09 devstack cinder-volume[85979]: DEBUG dbcounter [-] [85979] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85979) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:52:10 devstack cinder-volume[85979]: DEBUG dbcounter [-] [85979] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=85979) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:52:12 devstack cinder-volume[85979]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 01 23:52:13 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Acquiring lock "singleton_lock" {{(pid=85979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 23:52:13 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Acquired lock "singleton_lock" {{(pid=85979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 23:52:13 devstack cinder-volume[85979]: DEBUG oslo_concurrency.lockutils [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Releasing lock "singleton_lock" {{(pid=85979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 23:52:13 devstack cinder-volume[86286]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 23:52:13 devstack cinder-volume[86286]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 23:52:13 devstack cinder-volume[86286]: we strongly recommend against using it for new projects. Sep 01 23:52:13 devstack cinder-volume[86286]: If you are already using Eventlet, we recommend migrating to a different Sep 01 23:52:13 devstack cinder-volume[86286]: framework. For more detail see Sep 01 23:52:13 devstack cinder-volume[86286]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 23:52:13 devstack cinder-volume[86286]: import eventlet # noqa Sep 01 23:52:13 devstack cinder-volume[85979]: WARNING amqp [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 23:52:13 devstack cinder-volume[85979]: WARNING amqp [None req-9ec29314-e266-4e8a-811b-ccd31c4429dd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 23:52:15 devstack cinder-volume[86286]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86286) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 23:52:15 devstack cinder-volume[86286]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86286) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 23:52:15 devstack cinder-volume[86286]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86286) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 23:52:16 devstack cinder-volume[86286]: INFO dbcounter [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Registered counter for database cinder Sep 01 23:52:16 devstack cinder-volume[86286]: DEBUG oslo_db.sqlalchemy.engines [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:52:16 devstack cinder-volume[86286]: DEBUG dbcounter [-] [86286] Writer thread running {{(pid=86286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 23:52:16 devstack cinder-volume[86286]: INFO cinder.rpc [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 23:52:16 devstack cinder-volume[86286]: INFO cinder.rpc [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_db.sqlalchemy.engines [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:52:17 devstack cinder-volume[86286]: INFO cinder.volume.manager [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Determined volume DB was empty at startup. Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG cinder.volume.manager [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86286) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 23:52:17 devstack cinder-volume[86286]: WARNING stevedore.named [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 23:52:17 devstack cinder-volume[86286]: WARNING castellan.key_manager [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 23:52:17 devstack cinder-volume[86286]: WARNING cinder.keymgr.conf_key_mgr [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 23:52:17 devstack cinder-volume[86286]: INFO cinder.volume.manager [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_db.sqlalchemy.engines [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:52:17 devstack cinder-volume[86286]: INFO oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Starting 1 workers Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Started child 86591 {{(pid=86286) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Full set of CONF: {{(pid=86286) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] ******************************************************************************** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] Configuration options gathered from: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] ================================================================================ {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 23:52:17 devstack cinder-volume[86591]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] allow_availability_zone_fallback = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] allow_compression_on_image_upload = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] allowed_direct_url_schemes = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] api_rate_limit = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] auth_strategy = keystone {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_availability_zone = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_host = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_stats_polling_interval = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backup_api_class = cinder.backup.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backup_name_template = backup-%s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backup_use_same_host = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backup_use_temp_snapshot = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] chap_password = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] chap_username = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cinder_internal_tenant_project_id = 93988c8a8ba34a46bcaded4a3fd898a8 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cinder_internal_tenant_user_id = 67e51bbb83e546c8a113252c6808f8bb {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cluster = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] compression_format = gzip {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] compute_api_class = cinder.compute.nova.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] config_dir = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] config_source = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] control_exchange = openstack {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] debug = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] default_availability_zone = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] default_group_type = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] default_volume_type = QuobyteHD {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] disk_geometry = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] driver_client_cert = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] driver_client_cert_key = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] driver_data_namespace = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] driver_ssl_cert_path = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] driver_ssl_cert_verify = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] driver_use_ssl = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] enable_new_services = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] enable_unsupported_driver = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] enabled_backends = ['QuobyteHD'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] enforce_multipath_for_image_xfer = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] filter_function = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_api_insecure = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_api_servers = ['http://192.168.122.58/image'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_api_ssl_compression = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_ca_certificates_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_catalog_info = image:glance:publicURL {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_keyfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_num_retries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance_request_timeout = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] goodness_function = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] graceful_shutdown_timeout = 5 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] group_api_class = cinder.group.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] host = devstack {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_compress_on_upload = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_conversion_address_space_limit = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_conversion_cpu_limit = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_conversion_disable = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_upload_use_cinder_backend = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_upload_use_internal_tenant = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_volume_cache_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_volume_cache_max_count = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] image_volume_cache_max_size_gb = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] init_host_max_objects_retrieval = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] instance_format = [instance: %(uuid)s] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] iscsi_target_flags = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] iscsi_write_cache = on {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] iser_helper = tgtadm {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] iser_ip_address = 192.168.122.58 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] iser_port = 3260 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] log_color = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] log_config_append = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] log_dir = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] log_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] log_options = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] log_rotate_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] log_rotate_interval_type = days {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] log_rotation_type = none {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] max_age = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] max_logfile_count = 30 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] max_logfile_size_mb = 200 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] max_over_subscription_ratio = 20.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] message_reap_interval = 86400 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] message_ttl = 2592000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] migration_create_volume_timeout_secs = 300 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] monkey_patch = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] monkey_patch_modules = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] my_ip = 192.168.122.58 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86591) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] no_snapshot_gb_quota = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] num_iser_scan_tries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] num_shell_tries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] num_volume_device_scan_tries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] nvmeof_conn_info_version = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] nvmet_ns_id = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] nvmet_port_id = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] osapi_max_limit = 1000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] osapi_volume_ext_list = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] osapi_volume_listen_port = 8776 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] osapi_volume_use_ssl = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] osapi_volume_workers = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] per_volume_size_limit = -1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] periodic_fuzzy_delay = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] periodic_interval = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] public_endpoint = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] publish_errors = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] quota_backup_gigabytes = 1000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] quota_backups = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] quota_gigabytes = 1000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] quota_groups = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] quota_snapshots = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] quota_volumes = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] rate_limit_burst = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] rate_limit_except_level = CRITICAL {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] rate_limit_interval = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] reinit_driver_count = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] replication_device = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] report_discard_supported = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] report_interval = 120 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] reservation_clean_interval = 86400 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] reservation_expire = 86400 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] reserved_image_namespaces = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] reserved_percentage = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] rpc_response_timeout = 120 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] run_external_periodic_tasks = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] scst_target_driver = iscsi {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] scst_target_iqn_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_down_time = 720 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] shell_completion = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] snapshot_name_template = snapshot-%s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] split_loggers = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] state_path = /opt/stack/data/cinder {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] storage_availability_zone = nova {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] storage_protocol = iSCSI {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] syslog_log_facility = LOG_USER {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] target_helper = lioadm {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] target_ip_address = 192.168.122.58 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] target_port = 3260 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] target_protocol = iscsi {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] target_secondary_ip_addresses = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] trace_flags = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] transport_url = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] until_refresh = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] use_chap_auth = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] use_default_quota_class = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] use_journal = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] use_json = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] use_multipath_for_image_xfer = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] use_stderr = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] use_syslog = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] verify_glance_signatures = enabled {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_api_class = cinder.volume.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_backend_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_clear = zero {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_clear_ionice = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_clear_size = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_copy_bps_limit = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_dd_blocksize = 1M {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_name_template = volume-%s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_service_inithost_offload = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volume_usage_audit_period = month {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] zoning_mode = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_concurrency.disable_process_locking = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.auth_section = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.auth_type = password {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.auth_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.cache = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.include_service_catalog = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.insecure = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.interface = public {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.keyfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_password = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcache_username = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.region_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.service_type = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.58/identity {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.backend = dogpile.cache.null {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.backend_argument = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.backend_expiration_time = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.config_prefix = cache.oslo {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.debug_cache_backend = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.enable_retry_client = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.enable_socket_keepalive = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.expiration_time = 600 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.hashclient_retry_attempts = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.memcache_dead_retry = 300 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.memcache_pool_maxsize = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.memcache_sasl_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.password = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.proxies = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.redis_db = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.redis_server = localhost:6379 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.retry_attempts = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.retry_delay = 0.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.socket_keepalive_count = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.socket_keepalive_idle = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.socket_keepalive_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.socket_timeout = 1.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.tls_allowed_ciphers = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.tls_cafile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.tls_certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.tls_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.tls_keyfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cache.username = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] coordination.backend_url = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.asyncio_connection = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.asyncio_slave_connection = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.backend = sqlalchemy {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.connection = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.connection_debug = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.connection_parameters = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86591) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.connection_recycle_time = 3600 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.connection_trace = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.db_inc_retry_interval = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.db_max_retries = 20 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.db_max_retry_interval = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.db_retry_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.max_overflow = 50 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.max_pool_size = 5 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.max_retries = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.mysql_wsrep_sync_wait = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.pool_timeout = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.retry_interval = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.slave_connection = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.sqlite_synchronous = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.quobyte [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 23:52:17 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.quobyte [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.synchronous_reader = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] database.use_db_reconnect = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_tracing.insecure = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Running cmd (subprocess): mount.quobyte {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.connection_string = messaging:// {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.es_doc_type = notification {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.es_scroll_size = 10000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.es_scroll_time = 2m {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.filter_error_trace = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.hmac_keys = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.sentinel_service_name = mymaster {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.socket_timeout = 0.1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.trace_requests = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler.trace_sqlalchemy = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler_jaeger.process_tags = {} {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler_jaeger.service_name_prefix = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] profiler_otlp.service_name_prefix = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.enforce_new_defaults = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.policy_default_rule = default {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.policy_file = policy.yaml {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] privsep_osbrick.group = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] privsep_osbrick.helper_command = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] privsep_osbrick.user = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cinder_sys_admin.group = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cinder_sys_admin.helper_command = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] cinder_sys_admin.user = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.auth_section = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.auth_type = password {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.cafile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.collect_timing = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.insecure = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.keyfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.send_service_user_token = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.split_loggers = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.timeout = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.tls_ciphers = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] service_user.tls_min_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.auth_section = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.auth_type = password {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.collect_timing = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.insecure = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.keyfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.region_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.split_loggers = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.timeout = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.tls_ciphers = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] glance.tls_min_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.backend_availability_zone = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.chap_password = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.chap_username = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.disk_geometry = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.driver_client_cert = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.driver_client_cert_key = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.driver_data_namespace = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.driver_use_ssl = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.extra_capabilities = {} {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.filter_function = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.goodness_function = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.iscsi_target_flags = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.iscsi_write_cache = on {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.iser_helper = tgtadm {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.iser_ip_address = 192.168.122.58 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.iser_port = 3260 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_host = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_login = admin {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_mount_options = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_password = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_private_key = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_share_path = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.num_shell_tries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.quobyte_volume_url = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.replication_device = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.report_discard_supported = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.reserved_percentage = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.target_helper = tgtadm {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.target_ip_address = 192.168.122.58 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.target_port = 3260 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.target_protocol = iscsi {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.trace_flags = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.unique_fqdn_network = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.use_chap_auth = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.volume_backend_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.volume_clear = zero {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.volume_clear_ionice = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.volume_clear_size = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_reports.file_event_handler = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_reports.log_dir = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.backend_availability_zone = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.backend_host = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.chap_password = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.chap_username = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.chiscsi_conf = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.disk_geometry = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.driver_client_cert = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.driver_data_namespace = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.driver_use_ssl = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.extra_capabilities = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.filter_function = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.goodness_function = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack quobyte-client[86597]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 23:52:17 devstack quobyte-client[86597]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] CMD "mount.quobyte" returned: 1 in 0.099s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.iser_helper = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.iser_ip_address = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.iser_port = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.iser_target_prefix = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_host = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_login = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_mount_options = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_password = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_private_key = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_share_path = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_ssh_port = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.num_shell_tries = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.nvmet_port_id = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.replication_device = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.report_discard_supported = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.reserved_percentage = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.scst_target_driver = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.storage_protocol = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.target_helper = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.target_ip_address = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.target_port = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.target_prefix = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.target_protocol = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.trace_flags = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.use_chap_auth = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.volume_clear = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.volume_clear_size = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] QuobyteHD.volumes_dir = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.ssl = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_notifications.driver = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_notifications.retry = -1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] key_manager.fixed_key = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.barbican_api_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.barbican_endpoint = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.barbican_endpoint_type = public {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.barbican_region_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.cafile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.collect_timing = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.insecure = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.keyfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.number_of_retries = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.retry_delay = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.send_service_user_token = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.split_loggers = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.timeout = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.tls_ciphers = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.tls_min_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.verify_ssl = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican.verify_ssl_path = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.auth_section = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.auth_type = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.cafile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.collect_timing = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.insecure = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.keyfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.split_loggers = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.timeout = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.tls_ciphers = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] barbican_service_user.tls_min_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.approle_role_id = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.approle_secret_id = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.auth_method = approle {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.auth_path = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.kv_mountpoint = secret {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.kv_path = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.kv_version = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.namespace = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.root_token_id = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.ssl_ca_crt_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.timeout = 60.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.token_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.token_role = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.use_ssl = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 23:52:17 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-07ea32ad-a846-4e6c-b566-afcab0180a0e None None] ******************************************************************************** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 23:52:17 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:52:17 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:52:17 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:52:17 devstack cinder-volume[86591]: INFO cinder.volume.driver [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Driver hasn't implemented _init_vendor_properties() Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG cinder.volume.driver [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8815231323242, 'free_capacity_gb': 1773.8815231323242, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86591) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_db.sqlalchemy.engines [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writer thread running {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG cinder.db.api [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Building query based on filter {{(pid=86591) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86591) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:52:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:52:17 devstack cinder-volume[86591]: INFO cinder.keymgr.migration [None req-0950df32-83b6-4f56-a669-2d616aa33cca None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 23:52:17 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:52:17 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:52:18 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.244s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:52:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Driver initialization completed successfully. Sep 01 23:52:18 devstack cinder-volume[86591]: INFO cinder.manager [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Initiating service 3 cleanup Sep 01 23:52:18 devstack cinder-volume[86591]: INFO cinder.manager [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Service 3 cleanup completed. Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG cinder.service [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Creating RPC server for service cinder-volume {{(pid=86591) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG cinder.service [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86591) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 23:52:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:52:18 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:52:18 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:52:18 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Sep 01 23:52:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.248s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:52:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dd901421-f521-499a-b8aa-1d59bab2dfcf None None] Driver post RPC initialization completed successfully. Sep 01 23:52:27 devstack cinder-volume[86286]: DEBUG dbcounter [-] [86286] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:52:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=2 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:52:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:53:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:53:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 6 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:53:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Flow 'volume_create_manager' (97af9131-cf90-4fe6-ad55-c6406bc65167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8a7622-785e-4f60-ae8a-420bb5ff167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8a7622-785e-4f60-ae8a-420bb5ff167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-969149719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16548573b63a4af99714ae827fbfb353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:53:16Z,use_quota=True,user_id='9fb993e031bb47dfb4391338cf5f6f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ea6c3d-a4bb-4e58-971e-58d77b80a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ea6c3d-a4bb-4e58-971e-58d77b80a95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348d0a63-ffc7-4972-a9ee-6a25559fc826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348d0a63-ffc7-4972-a9ee-6a25559fc826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16', 'volume_name': 'volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8212256f-16ff-44e1-bfb0-7c6bdd1ebcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8212256f-16ff-44e1-bfb0-7c6bdd1ebcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b353994-c30e-4de6-9903-dec5280122d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Volume 8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16', 'volume_size': 1} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-969149719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16548573b63a4af99714ae827fbfb353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:53:16Z,use_quota=True,user_id='9fb993e031bb47dfb4391338cf5f6f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Creating volume 8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:53:16 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:53:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:53:16 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 1073741824 Sep 01 23:53:16 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:17 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 1073741824" returned: 0 in 0.712s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:53:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:53:17 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 Sep 01 23:53:17 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:17 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:53:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:53:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:53:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b353994-c30e-4de6-9903-dec5280122d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bc7b9f-e4e6-44e8-b16c-dca0ceaf7693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Volume volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 (8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16): created successfully Sep 01 23:53:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bc7b9f-e4e6-44e8-b16c-dca0ceaf7693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Flow 'volume_create_manager' (97af9131-cf90-4fe6-ad55-c6406bc65167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:53:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1110c854-feca-4283-a25b-296e2aa3a982 tempest-TaggedAttachmentsTest-1746828606 None] Created volume successfully. Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Flow 'volume_create_manager' (98aecbdf-f6b8-418c-b919-70b2e54bf0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a981afa8-e5b4-4114-8eeb-c23fc46ec2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a981afa8-e5b4-4114-8eeb-c23fc46ec2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1300319608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece08062-3def-43e5-8e13-793b19ac8ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6925903b5344a039ace165a68cc7afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:53:27Z,use_quota=True,user_id='6b2ab2f612614de1811b4d4788b47dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a730cfff-3a39-4849-89e3-05a2519062e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a730cfff-3a39-4849-89e3-05a2519062e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c2f5cf-cded-4c7f-b5c5-8caeb64338c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c2f5cf-cded-4c7f-b5c5-8caeb64338c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece08062-3def-43e5-8e13-793b19ac8ce3', 'volume_name': 'volume-ece08062-3def-43e5-8e13-793b19ac8ce3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d845771e-36ad-4f4e-b156-e2fa295d2a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d845771e-36ad-4f4e-b156-e2fa295d2a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70b08e7-1c02-4b39-915d-3faf9a2e0534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:27 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Volume ece08062-3def-43e5-8e13-793b19ac8ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece08062-3def-43e5-8e13-793b19ac8ce3', 'volume_size': 1} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1300319608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece08062-3def-43e5-8e13-793b19ac8ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6925903b5344a039ace165a68cc7afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:53:27Z,use_quota=True,user_id='6b2ab2f612614de1811b4d4788b47dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Creating volume ece08062-3def-43e5-8e13-793b19ac8ce3 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:53:27 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:53:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:53:27 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3 1073741824 Sep 01 23:53:27 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:28 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3 1073741824" returned: 0 in 1.143s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:53:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:53:28 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3 Sep 01 23:53:28 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:29 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3" returned: 0 in 0.873s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:53:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:53:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:53:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70b08e7-1c02-4b39-915d-3faf9a2e0534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece08062-3def-43e5-8e13-793b19ac8ce3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a319f9-0350-47a8-bc7c-7bba93d118ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:29 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Volume volume-ece08062-3def-43e5-8e13-793b19ac8ce3 (ece08062-3def-43e5-8e13-793b19ac8ce3): created successfully Sep 01 23:53:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a319f9-0350-47a8-bc7c-7bba93d118ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Flow 'volume_create_manager' (98aecbdf-f6b8-418c-b919-70b2e54bf0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:53:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-91c0b27d-7cf5-43df-9557-4beed196f72d tempest-DeleteServersTestJSON-428103955 None] Created volume successfully. Sep 01 23:53:37 devstack cinder-volume[86591]: WARNING py.warnings [req-2a6483d7-2f95-40ac-83be-42e247da3d30 req-7ef216bf-d495-4452-87d9-e17f24a69a72 tempest-DeleteServersTestJSON-428103955 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 01 23:53:37 devstack cinder-volume[86591]: .first() Sep 01 23:53:37 devstack cinder-volume[86591]: Sep 01 23:53:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2a6483d7-2f95-40ac-83be-42e247da3d30 req-7ef216bf-d495-4452-87d9-e17f24a69a72 tempest-DeleteServersTestJSON-428103955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:53:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2a6483d7-2f95-40ac-83be-42e247da3d30 req-7ef216bf-d495-4452-87d9-e17f24a69a72 tempest-DeleteServersTestJSON-428103955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:53:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2a6483d7-2f95-40ac-83be-42e247da3d30 req-7ef216bf-d495-4452-87d9-e17f24a69a72 tempest-DeleteServersTestJSON-428103955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:53:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-2a6483d7-2f95-40ac-83be-42e247da3d30 req-7ef216bf-d495-4452-87d9-e17f24a69a72 tempest-DeleteServersTestJSON-428103955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-ece08062-3def-43e5-8e13-793b19ac8ce3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f59ebb4b-a94b-424c-a20b-20047f0f0c8b', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 23:53:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-2a6483d7-2f95-40ac-83be-42e247da3d30 req-7ef216bf-d495-4452-87d9-e17f24a69a72 tempest-DeleteServersTestJSON-428103955 None] attachment_update completed successfully. Sep 01 23:53:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-a13d2ea5-0407-4588-82eb-c984e2cb88c8 req-393b4fd5-345e-41ab-b4b0-9ca109924960 tempest-DeleteServersTestJSON-428103955 None] Terminate volume connection completed successfully. Sep 01 23:53:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-a13d2ea5-0407-4588-82eb-c984e2cb88c8 req-393b4fd5-345e-41ab-b4b0-9ca109924960 tempest-DeleteServersTestJSON-428103955 None] Deleting attachment f59ebb4b-a94b-424c-a20b-20047f0f0c8b. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 23:53:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Acquiring lock "cinder-ece08062-3def-43e5-8e13-793b19ac8ce3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:53:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Lock "cinder-ece08062-3def-43e5-8e13-793b19ac8ce3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:53:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Acquiring lock "cinder-quobyte-ece08062-3def-43e5-8e13-793b19ac8ce3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:53:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Lock "cinder-quobyte-ece08062-3def-43e5-8e13-793b19ac8ce3" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:53:45 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpg2c_u8y4/privsep.sock'] Sep 01 23:53:45 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpg2c_u8y4/privsep.sock Sep 01 23:53:45 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:46 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 23:53:46 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 23:53:46 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 23:53:46 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 23:53:46 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 23:53:46 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 23:53:46 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 23:53:46 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 23:53:46 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 23:53:46 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:46 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Spawned new privsep daemon via rootwrap Sep 01 23:53:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Accepted privsep connection to /tmp/tmpg2c_u8y4/privsep.sock {{(pid=86591) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 23:53:46 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 23:53:46 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 23:53:46 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 23:53:46 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88198 Sep 01 23:53:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[703382dd-2362-4756-8738-c61396352b18]: (2,) {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:53:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b08d61-e917-4fba-98e9-45c4cd72130a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:53:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:53:47 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3 Sep 01 23:53:47 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:47 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3" returned: 0 in 0.509s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:53:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:53:47 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3 Sep 01 23:53:47 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:47 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ece08062-3def-43e5-8e13-793b19ac8ce3" returned: 0 in 0.432s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:53:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Lock "cinder-quobyte-ece08062-3def-43e5-8e13-793b19ac8ce3" released by "delete_volume" :: held 2.468s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:53:47 devstack cinder-volume[86591]: WARNING cinder.quota [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:53:47 devstack cinder-volume[86591]: WARNING cinder.quota [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:53:47 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Created reservations ['0db079ac-43c3-4477-be9c-d65e039a4a97', '7270a5b0-915f-4385-aa61-4aa187634edd', '952262b2-791d-4b5b-9a13-ce461d6c82b7', '5da2b372-70f0-4dc2-b460-446c711b26b2'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:53:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:53:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:53:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:53:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:53:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:53:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:53:48 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:53:48 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:48 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.314s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:53:48 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:53:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Deleted volume successfully. Sep 01 23:53:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e7a5502-85fd-49cb-bc26-b6674d1101b8 tempest-DeleteServersTestJSON-428103955 None] Lock "cinder-ece08062-3def-43e5-8e13-793b19ac8ce3-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Flow 'volume_create_manager' (d9fb997f-e5b0-4b47-b15b-fc3c4d97f916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e728ec6e-428b-4e72-b484-d7b9a7c11da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e728ec6e-428b-4e72-b484-d7b9a7c11da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-73459727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1617e40-6f6c-4c62-99e8-28f4eb71e1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='644ed24fbd3e4961af86fa92422a822e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:53:55Z,use_quota=True,user_id='95085ed24b474d04ad87aa286666e6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7978c8-e607-4c3a-bdfe-c62f1e056531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7978c8-e607-4c3a-bdfe-c62f1e056531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e878f8-9fde-4333-be14-f2f8a469e255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e878f8-9fde-4333-be14-f2f8a469e255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1617e40-6f6c-4c62-99e8-28f4eb71e1e0', 'volume_name': 'volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0aca67-d3c0-4026-99e7-2c7853d0d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0aca67-d3c0-4026-99e7-2c7853d0d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b63d31-9bd4-4591-be3f-8fe887e9573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Volume f1617e40-6f6c-4c62-99e8-28f4eb71e1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0', 'volume_size': 1} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-73459727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1617e40-6f6c-4c62-99e8-28f4eb71e1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='644ed24fbd3e4961af86fa92422a822e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:53:55Z,use_quota=True,user_id='95085ed24b474d04ad87aa286666e6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Creating volume f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:53:55 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:53:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:53:55 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 1073741824 Sep 01 23:53:55 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:56 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 1073741824" returned: 0 in 0.650s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:53:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:53:56 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 Sep 01 23:53:56 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:53:56 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Sep 01 23:53:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0" returned: 0 in 0.369s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:53:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:53:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:53:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b63d31-9bd4-4591-be3f-8fe887e9573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efac54d7-0a20-469e-bac9-65baa8b448d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:53:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Volume volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 (f1617e40-6f6c-4c62-99e8-28f4eb71e1e0): created successfully Sep 01 23:53:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efac54d7-0a20-469e-bac9-65baa8b448d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:53:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Flow 'volume_create_manager' (d9fb997f-e5b0-4b47-b15b-fc3c4d97f916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:53:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-54deed1a-5b37-455c-af62-322b91e8ae11 tempest-ServerActionsTestOtherA-1621420664 None] Created volume successfully. Sep 01 23:53:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-29f296e9-83ad-494f-8117-2cdcaae4f071 tempest-GroupSnapshotsTest-1992265274 None] Group tempest-GroupSnapshotsTest-Group-705665984: creating Sep 01 23:54:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-29f296e9-83ad-494f-8117-2cdcaae4f071 tempest-GroupSnapshotsTest-1992265274 None] Group tempest-GroupSnapshotsTest-Group-705665984: created successfully Sep 01 23:54:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-29f296e9-83ad-494f-8117-2cdcaae4f071 tempest-GroupSnapshotsTest-1992265274 None] Create group completed successfully. Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Flow 'volume_create_manager' (aac42d54-153d-4dfe-8b27-cb0ef449a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c499d-358c-4dae-ab01-c26264785c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c499d-358c-4dae-ab01-c26264785c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1772171337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d386effa-43b2-465c-9517-683dc38afb4a,host='devstack@QuobyteHD#QuobyteHD',id=2a8a49d8-0685-4112-acf4-35d9b91b3ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3ac48ad68434f863acc0b61fba08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:54:02Z,use_quota=True,user_id='a947f394fd4543d8b1ae5a1e0a6c7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7204b96-8032-4308-ac9b-9745989c3ad5),volume_type_id=a7204b96-8032-4308-ac9b-9745989c3ad5)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b59a83-0c02-48db-9ebd-b2bc4514c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b59a83-0c02-48db-9ebd-b2bc4514c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68898fc3-e52d-4379-99d8-a47e230829aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68898fc3-e52d-4379-99d8-a47e230829aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8a49d8-0685-4112-acf4-35d9b91b3ce5', 'volume_name': 'volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a919311-3646-4b3f-aff2-461bf5e10f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a919311-3646-4b3f-aff2-461bf5e10f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d080cf10-838a-4f89-9a25-c48a90c647a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Volume 2a8a49d8-0685-4112-acf4-35d9b91b3ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5', 'volume_size': 1} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d386effa-43b2-465c-9517-683dc38afb4a,created_at=2026-09-01T21:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1772171337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d386effa-43b2-465c-9517-683dc38afb4a,host='devstack@QuobyteHD#QuobyteHD',id=2a8a49d8-0685-4112-acf4-35d9b91b3ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3ac48ad68434f863acc0b61fba08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:54:02Z,use_quota=True,user_id='a947f394fd4543d8b1ae5a1e0a6c7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7204b96-8032-4308-ac9b-9745989c3ad5),volume_type_id=a7204b96-8032-4308-ac9b-9745989c3ad5)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Creating volume 2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:54:02 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:02 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 1073741824 Sep 01 23:54:02 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:02 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 1073741824" returned: 0 in 0.527s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:02 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 Sep 01 23:54:02 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:02 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d080cf10-838a-4f89-9a25-c48a90c647a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99e5ca9-8ec7-4df4-bc2c-f5ae3ca54285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:02 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Volume volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 (2a8a49d8-0685-4112-acf4-35d9b91b3ce5): created successfully Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99e5ca9-8ec7-4df4-bc2c-f5ae3ca54285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Flow 'volume_create_manager' (aac42d54-153d-4dfe-8b27-cb0ef449a399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:54:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-93a8100d-e343-405e-b799-ad62fda37d1a tempest-GroupSnapshotsTest-1992265274 None] Created volume successfully. Sep 01 23:54:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] GroupSnapshot 1f06c8e1-6919-4663-a4a4-63c8d6ae8a4b: creating. Sep 01 23:54:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Group snapshot 1f06c8e1-6919-4663-a4a4-63c8d6ae8a4b: creating. {{(pid=86591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 23:54:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Creating offline snapshot f6b0a9b1-25c6-4480-b3f7-82b514666673 of volume 2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:54:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940d562-cdc5-4591-afd4-ded6c94f9075]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:03 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 Sep 01 23:54:03 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:04 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" returned: 0 in 0.484s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:04 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 1G Sep 01 23:54:04 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:04 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 1G" returned: 0 in 0.678s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:04 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 Sep 01 23:54:04 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:05 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673" returned: 0 in 0.595s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:05 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:54:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:05 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 Sep 01 23:54:05 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:05 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673" returned: 0 in 0.408s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:05 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.info Sep 01 23:54:05 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:06 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.info" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:06 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:06 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.info Sep 01 23:54:06 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:06 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:54:06 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:06 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.info" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.096s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e0ef7740-b556-485e-8976-80b85caf0aba tempest-GroupSnapshotsTest-1992265274 None] group_snapshot 1f06c8e1-6919-4663-a4a4-63c8d6ae8a4b: created successfully Sep 01 23:54:07 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.571s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:54:07 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:54:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 8 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:54:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=30,cinder:SELECT=28,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=29,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-f6b0a9b1-25c6-4480-b3f7-82b514666673-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-f6b0a9b1-25c6-4480-b3f7-82b514666673-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Creating volume ea95fd94-7a1f-4aef-ac2a-9645171dd6ff from snapshot f6b0a9b1-25c6-4480-b3f7-82b514666673 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] snapshot: f6b0a9b1-25c6-4480-b3f7-82b514666673, volume: ea95fd94-7a1f-4aef-ac2a-9645171dd6ff, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa53578-6c1e-49bd-9df5-49e19bf2e334]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:09 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 Sep 01 23:54:09 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:10 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:54:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e82941-3c3f-4fc4-ba37-db3f3f66aa5e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:10 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 Sep 01 23:54:10 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:10 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" returned: 0 in 0.537s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 23:54:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 23:54:10 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 23:54:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:10 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff Sep 01 23:54:10 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:18 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" returned: 0 in 7.821s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:18 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 23:54:18 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Converted 1024.00 MB image at 130.89 MB/s Sep 01 23:54:18 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:54:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:18 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff Sep 01 23:54:18 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:18 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" returned: 0 in 0.325s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" released by "_copy_volume_from_snapshot" :: held 9.311s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-f6b0a9b1-25c6-4480-b3f7-82b514666673-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" released by "_create_volume_from_snapshot" :: held 9.431s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.472s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-985cd891-3e0e-4acb-9124-de1bfd73ddf7 tempest-GroupSnapshotsTest-1992265274 None] Create group from source-snapshot-1f06c8e1-6919-4663-a4a4-63c8d6ae8a4b completed successfully. Sep 01 23:54:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[189118b0-8a9e-4228-891d-24f76319ddc3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:21 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff Sep 01 23:54:21 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:21 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" returned: 0 in 0.600s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:21 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff Sep 01 23:54:21 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-f713b286-962b-4ad0-9158-8eeabd158615 req-ea793b9c-8876-4c83-898c-542439951091 tempest-TaggedAttachmentsTest-1746828606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-f713b286-962b-4ad0-9158-8eeabd158615 req-ea793b9c-8876-4c83-898c-542439951091 tempest-TaggedAttachmentsTest-1746828606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-f713b286-962b-4ad0-9158-8eeabd158615 req-ea793b9c-8876-4c83-898c-542439951091 tempest-TaggedAttachmentsTest-1746828606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-f713b286-962b-4ad0-9158-8eeabd158615 req-ea793b9c-8876-4c83-898c-542439951091 tempest-TaggedAttachmentsTest-1746828606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38999ef1-e7b0-4ba0-808a-44870990ab64', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 23:54:21 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-ea95fd94-7a1f-4aef-ac2a-9645171dd6ff" released by "delete_volume" :: held 0.996s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-f713b286-962b-4ad0-9158-8eeabd158615 req-ea793b9c-8876-4c83-898c-542439951091 tempest-TaggedAttachmentsTest-1746828606 None] attachment_update completed successfully. Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['8718458a-30b0-4ecd-abf4-8aac7e3f498e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:54:22 devstack cinder-volume[86591]: WARNING cinder.quota [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1224565006 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1224565006, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:54:22 devstack cinder-volume[86591]: WARNING cinder.quota [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1224565006 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1224565006, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['819678fd-f876-4420-bf2a-1041fc24dc74', '3d3cb6f4-c57f-46a6-9cde-c644414ecaab', 'aeb655c1-37a0-4d4d-ae37-595dcc763826', '96590e79-ef7c-453f-96f1-708390fb06ad'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:22 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:54:22 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:22 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.341s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:22 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:54:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9846e25b-546a-429d-970e-1dc25c942f40 tempest-GroupSnapshotsTest-1992265274 None] Delete group completed successfully. Sep 01 23:54:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] group_snapshot 1f06c8e1-6919-4663-a4a4-63c8d6ae8a4b: deleting Sep 01 23:54:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] group_snapshot 1f06c8e1-6919-4663-a4a4-63c8d6ae8a4b: deleting {{(pid=86591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 23:54:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-f6b0a9b1-25c6-4480-b3f7-82b514666673" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-f6b0a9b1-25c6-4480-b3f7-82b514666673" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Deleting offline snapshot f6b0a9b1-25c6-4480-b3f7-82b514666673 of volume 2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:54:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] snapshot_file for this snap is: volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:54:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[023c0c12-ae78-4524-9607-de23f804ba7e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:23 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 Sep 01 23:54:23 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:24 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:54:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a5ba6d-bcc0-43c9-8789-5bb540e1d9ae]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:24 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 Sep 01 23:54:24 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:24 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" returned: 0 in 0.722s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:24 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 Sep 01 23:54:24 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-73698380-dddf-4f4b-b807-621a8a3c51e7 req-5655d535-0ed6-470f-b844-121ad33997ca tempest-TaggedAttachmentsTest-1746828606 None] Terminate volume connection completed successfully. Sep 01 23:54:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-73698380-dddf-4f4b-b807-621a8a3c51e7 req-5655d535-0ed6-470f-b844-121ad33997ca tempest-TaggedAttachmentsTest-1746828606 None] Deleting attachment 38999ef1-e7b0-4ba0-808a-44870990ab64. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 23:54:25 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673" returned: 0 in 0.531s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:25 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673 Sep 01 23:54:25 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:25 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5.f6b0a9b1-25c6-4480-b3f7-82b514666673" returned: 0 in 0.283s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-f6b0a9b1-25c6-4480-b3f7-82b514666673" released by "_delete_snapshot" :: held 2.121s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" released by "delete_snapshot" :: held 2.149s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:25 devstack cinder-volume[86591]: WARNING cinder.quota [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1224565006 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1224565006, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:54:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['061c1ce4-de28-4873-bc46-be4bd392842f', '45148840-e0c5-48ed-8e62-d5bf16da8668', 'eeb7b46b-93ca-4c6d-a126-ea634d42705d', '9c83672c-217d-4d6e-ac39-66e3a74a9445'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:54:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ebd00a57-da43-480f-9b3a-0d628308d62b tempest-GroupSnapshotsTest-1992265274 None] group_snapshot 1f06c8e1-6919-4663-a4a4-63c8d6ae8a4b: deleted successfully Sep 01 23:54:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[059997eb-428e-4e02-afa9-c6d1abc540a1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:27 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 Sep 01 23:54:27 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:27 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" returned: 0 in 0.512s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:27 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5 Sep 01 23:54:27 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:28 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" returned: 0 in 0.317s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-2a8a49d8-0685-4112-acf4-35d9b91b3ce5" released by "delete_volume" :: held 0.915s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['5cdff285-6ce1-462a-881f-3645368bd91a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:54:28 devstack cinder-volume[86591]: WARNING cinder.db.api [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1224565006'] Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['d6cc3f7b-81bf-42e5-86b4-6684dcd4c7f5', '1b3f6d4e-f12e-4d96-b1d3-62622ac525e3', 'b1eb2ddc-cafc-4b5d-af5b-67245c88f03b', '429b71c3-c341-40e2-84fb-7b0ec9c5d6c9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:28 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:54:28 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:28 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:28 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:54:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-daadbe1d-a41c-44d7-99ab-5202bb48f585 tempest-GroupSnapshotsTest-1992265274 None] Delete group completed successfully. Sep 01 23:54:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-59b3a384-9abd-4a75-a966-b6a08ff7b0f5 tempest-GroupSnapshotsTest-1992265274 None] Group tempest-GroupSnapshotsTest-Group-764677098: creating Sep 01 23:54:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-59b3a384-9abd-4a75-a966-b6a08ff7b0f5 tempest-GroupSnapshotsTest-1992265274 None] Group tempest-GroupSnapshotsTest-Group-764677098: created successfully Sep 01 23:54:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-59b3a384-9abd-4a75-a966-b6a08ff7b0f5 tempest-GroupSnapshotsTest-1992265274 None] Create group completed successfully. Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Flow 'volume_create_manager' (4f26e746-93f9-4dc9-864b-c3feb6a4022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a5c918-7aab-4be1-9c67-7670cc718e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a5c918-7aab-4be1-9c67-7670cc718e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1758812905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=553082af-c7ca-4707-8da8-1a5af10ebc37,host='devstack@QuobyteHD#QuobyteHD',id=7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3ac48ad68434f863acc0b61fba08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:54:32Z,use_quota=True,user_id='a947f394fd4543d8b1ae5a1e0a6c7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c7f1af0-78cc-4d06-b4a4-3ee6ca1fa641),volume_type_id=9c7f1af0-78cc-4d06-b4a4-3ee6ca1fa641)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcd909e-051b-4765-9e76-e98221bf3653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcd909e-051b-4765-9e76-e98221bf3653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c73e1e-e51f-469a-9b94-faacfd6883b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c73e1e-e51f-469a-9b94-faacfd6883b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677', 'volume_name': 'volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed1dd96-7ab1-48df-9e4b-8d215cbf4fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed1dd96-7ab1-48df-9e4b-8d215cbf4fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4426648-0d95-44bc-a6a0-613be0e22604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:32 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Volume 7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677', 'volume_size': 1} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=553082af-c7ca-4707-8da8-1a5af10ebc37,created_at=2026-09-01T21:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1758812905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=553082af-c7ca-4707-8da8-1a5af10ebc37,host='devstack@QuobyteHD#QuobyteHD',id=7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3ac48ad68434f863acc0b61fba08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:54:32Z,use_quota=True,user_id='a947f394fd4543d8b1ae5a1e0a6c7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c7f1af0-78cc-4d06-b4a4-3ee6ca1fa641),volume_type_id=9c7f1af0-78cc-4d06-b4a4-3ee6ca1fa641)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Creating volume 7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:54:32 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:32 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 1073741824 Sep 01 23:54:32 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:32 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 1073741824" returned: 0 in 0.614s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:33 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 Sep 01 23:54:33 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:33 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" returned: 0 in 0.452s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:54:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4426648-0d95-44bc-a6a0-613be0e22604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff8c340-a0c7-46fa-80b0-a1c128eb10e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Volume volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 (7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677): created successfully Sep 01 23:54:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff8c340-a0c7-46fa-80b0-a1c128eb10e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Flow 'volume_create_manager' (4f26e746-93f9-4dc9-864b-c3feb6a4022b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:54:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6b6ef483-ef4b-4f58-bd9d-053fbf1d94ac tempest-GroupSnapshotsTest-1992265274 None] Created volume successfully. Sep 01 23:54:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-9f0adba4-f301-4e9c-9e26-528fae5112ab req-0b863ec7-c83c-4860-82b8-a819ce20f588 tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-9f0adba4-f301-4e9c-9e26-528fae5112ab req-0b863ec7-c83c-4860-82b8-a819ce20f588 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-9f0adba4-f301-4e9c-9e26-528fae5112ab req-0b863ec7-c83c-4860-82b8-a819ce20f588 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-9f0adba4-f301-4e9c-9e26-528fae5112ab req-0b863ec7-c83c-4860-82b8-a819ce20f588 tempest-ServerActionsTestOtherA-1621420664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a62d03fa-3882-45a3-805a-6337b5ac840b', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 23:54:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-9f0adba4-f301-4e9c-9e26-528fae5112ab req-0b863ec7-c83c-4860-82b8-a819ce20f588 tempest-ServerActionsTestOtherA-1621420664 None] attachment_update completed successfully. Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Flow 'volume_create_manager' (f99d11dd-059d-4bda-828d-5a9b29da5874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c22fcd-49a9-47c1-a76c-459595c86405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c22fcd-49a9-47c1-a76c-459595c86405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-816606378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=553082af-c7ca-4707-8da8-1a5af10ebc37,host='devstack@QuobyteHD#QuobyteHD',id=c1566108-392a-4a9a-bf19-0a31705bbcd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3ac48ad68434f863acc0b61fba08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:54:35Z,use_quota=True,user_id='a947f394fd4543d8b1ae5a1e0a6c7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c7f1af0-78cc-4d06-b4a4-3ee6ca1fa641),volume_type_id=9c7f1af0-78cc-4d06-b4a4-3ee6ca1fa641)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223e8bf9-7214-4506-aef0-22eb1341d50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223e8bf9-7214-4506-aef0-22eb1341d50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de10b6ba-242f-46b2-b3eb-af7b7b07c062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de10b6ba-242f-46b2-b3eb-af7b7b07c062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1566108-392a-4a9a-bf19-0a31705bbcd6', 'volume_name': 'volume-c1566108-392a-4a9a-bf19-0a31705bbcd6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f521bea-6b85-48b1-9fc2-24ff5dfcd157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f521bea-6b85-48b1-9fc2-24ff5dfcd157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6243283b-8b3f-4247-99c7-6b8451b4ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Volume c1566108-392a-4a9a-bf19-0a31705bbcd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1566108-392a-4a9a-bf19-0a31705bbcd6', 'volume_size': 1} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=553082af-c7ca-4707-8da8-1a5af10ebc37,created_at=2026-09-01T21:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-816606378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=553082af-c7ca-4707-8da8-1a5af10ebc37,host='devstack@QuobyteHD#QuobyteHD',id=c1566108-392a-4a9a-bf19-0a31705bbcd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3ac48ad68434f863acc0b61fba08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:54:35Z,use_quota=True,user_id='a947f394fd4543d8b1ae5a1e0a6c7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c7f1af0-78cc-4d06-b4a4-3ee6ca1fa641),volume_type_id=9c7f1af0-78cc-4d06-b4a4-3ee6ca1fa641)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Creating volume c1566108-392a-4a9a-bf19-0a31705bbcd6 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:54:35 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:54:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:35 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 1073741824 Sep 01 23:54:35 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:36 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 1073741824" returned: 0 in 0.604s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:36 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 Sep 01 23:54:36 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:36 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6" returned: 0 in 0.601s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:54:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6243283b-8b3f-4247-99c7-6b8451b4ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1566108-392a-4a9a-bf19-0a31705bbcd6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f986e24c-6a7f-4c84-9420-d42e740f12a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Volume volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 (c1566108-392a-4a9a-bf19-0a31705bbcd6): created successfully Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f986e24c-6a7f-4c84-9420-d42e740f12a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Flow 'volume_create_manager' (f99d11dd-059d-4bda-828d-5a9b29da5874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:54:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-45b9ee1c-aafa-4d6f-a7e3-3b8045ffeccf tempest-GroupSnapshotsTest-1992265274 None] Created volume successfully. Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Acquiring lock "cinder-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Lock "cinder-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Acquiring lock "cinder-quobyte-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Lock "cinder-quobyte-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b24f564-7b80-4eac-9c5e-4e57a5b469cf]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:37 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 Sep 01 23:54:37 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:37 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:37 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16 Sep 01 23:54:37 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:38 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16" returned: 0 in 0.318s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Lock "cinder-quobyte-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16" released by "delete_volume" :: held 0.854s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Created reservations ['0e09f2b2-d100-464f-9f00-859308e42425', 'f62a2727-1aef-4b94-99d3-286f1d7ca750', '4cac4935-4424-4446-b1c0-516a92f3ff9e', 'ed1de1b4-fd94-422b-a27a-14ac9c5361b5'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:38 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:54:38 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-493626bb-05c7-4061-a997-9b66a834753d tempest-GroupSnapshotsTest-1992265274 None] Update group completed successfully. Sep 01 23:54:38 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:54:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Deleted volume successfully. Sep 01 23:54:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1a2d4a49-4484-49d8-ad05-a698993b0e3f tempest-TaggedAttachmentsTest-1746828606 None] Lock "cinder-8b6ac49a-08dc-4d08-a2c2-58c81d6bcf16-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-02b55dbd-ba89-4555-a751-29006656d146 req-47c6d118-873e-412a-8d87-2fb3e5537a5b tempest-ServerActionsTestOtherA-1621420664 None] Terminate volume connection completed successfully. Sep 01 23:54:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-02b55dbd-ba89-4555-a751-29006656d146 req-47c6d118-873e-412a-8d87-2fb3e5537a5b tempest-ServerActionsTestOtherA-1621420664 None] Deleting attachment a62d03fa-3882-45a3-805a-6337b5ac840b. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 23:54:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b685bfa3-cad8-463f-92ce-4a1fd3334d0b tempest-GroupSnapshotsTest-1992265274 None] Update group completed successfully. Sep 01 23:54:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-02b55dbd-ba89-4555-a751-29006656d146 req-5539034d-4498-4188-a2d2-564dc4ad7cfb tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-02b55dbd-ba89-4555-a751-29006656d146 req-5539034d-4498-4188-a2d2-564dc4ad7cfb tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-02b55dbd-ba89-4555-a751-29006656d146 req-5539034d-4498-4188-a2d2-564dc4ad7cfb tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-02b55dbd-ba89-4555-a751-29006656d146 req-5539034d-4498-4188-a2d2-564dc4ad7cfb tempest-ServerActionsTestOtherA-1621420664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8f59b94-1b3e-4dfc-b48c-3e221be09ee9', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 23:54:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-02b55dbd-ba89-4555-a751-29006656d146 req-5539034d-4498-4188-a2d2-564dc4ad7cfb tempest-ServerActionsTestOtherA-1621420664 None] attachment_update completed successfully. Sep 01 23:54:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8cb5669f-3ee2-48a3-9c0a-bc68f90c738e tempest-GroupSnapshotsTest-1992265274 None] Update group completed successfully. Sep 01 23:54:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2a0608ce-cc62-483a-9105-7ff7172110c8 tempest-GroupSnapshotsTest-1992265274 None] Update group completed successfully. Sep 01 23:54:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] GroupSnapshot 4d450642-43eb-4a77-997b-ba7ea4414e16: creating. Sep 01 23:54:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Group snapshot 4d450642-43eb-4a77-997b-ba7ea4414e16: creating. {{(pid=86591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 23:54:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Creating offline snapshot e30fd156-5db9-4227-89f2-378858ff9e8f of volume c1566108-392a-4a9a-bf19-0a31705bbcd6 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:54:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaf6a53-026f-4af4-ab25-416e42411a1f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:44 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 Sep 01 23:54:45 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:45 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6" returned: 0 in 0.685s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:45 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f 1G Sep 01 23:54:45 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:46 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f 1G" returned: 0 in 0.670s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:46 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f Sep 01 23:54:46 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:46 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f" returned: 0 in 0.633s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:46 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:54:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:46 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f Sep 01 23:54:46 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:47 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f" returned: 0 in 0.469s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:47 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.info Sep 01 23:54:47 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:47 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.info" returned: 0 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:47 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:54:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:47 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.info Sep 01 23:54:47 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:48 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.info" returned: 0 in 0.426s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.390s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Creating offline snapshot f3b7b46d-a53a-41dd-beed-c18684cd47e1 of volume 7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:54:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dc324f-a2e0-4ef0-8253-db36d064837f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:48 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 Sep 01 23:54:48 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:48 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" returned: 0 in 0.519s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:48 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 1G Sep 01 23:54:48 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:49 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 1G" returned: 0 in 0.773s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:49 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 Sep 01 23:54:49 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:50 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1" returned: 0 in 0.567s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:50 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:54:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:50 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 Sep 01 23:54:50 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:50 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1" returned: 0 in 0.458s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:50 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.info Sep 01 23:54:50 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:50 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.info" returned: 0 in 0.430s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:51 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:54:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:51 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.info Sep 01 23:54:51 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:51 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.info" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.205s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7f36f63f-6a9e-4ea4-89e7-002ff7f65c2f tempest-GroupSnapshotsTest-1992265274 None] group_snapshot 4d450642-43eb-4a77-997b-ba7ea4414e16: created successfully Sep 01 23:54:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] group_snapshot 4d450642-43eb-4a77-997b-ba7ea4414e16: deleting Sep 01 23:54:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] group_snapshot 4d450642-43eb-4a77-997b-ba7ea4414e16: deleting {{(pid=86591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 23:54:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-c1566108-392a-4a9a-bf19-0a31705bbcd6" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-c1566108-392a-4a9a-bf19-0a31705bbcd6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-e30fd156-5db9-4227-89f2-378858ff9e8f" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-e30fd156-5db9-4227-89f2-378858ff9e8f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Deleting offline snapshot e30fd156-5db9-4227-89f2-378858ff9e8f of volume c1566108-392a-4a9a-bf19-0a31705bbcd6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:54:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] snapshot_file for this snap is: volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:54:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[decc5c7e-7402-4a64-8b54-b790aa843c35]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:52 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f Sep 01 23:54:52 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:53 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f" returned: 0 in 1.051s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1566108-392a-4a9a-bf19-0a31705bbcd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:54:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f044227-dea7-438c-a361-58a870c89a7c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:54 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 Sep 01 23:54:54 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:54 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6" returned: 0 in 0.772s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:54 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f Sep 01 23:54:54 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:55 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f" returned: 0 in 1.095s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:55 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f Sep 01 23:54:55 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:56 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6.e30fd156-5db9-4227-89f2-378858ff9e8f" returned: 0 in 0.439s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-e30fd156-5db9-4227-89f2-378858ff9e8f" released by "_delete_snapshot" :: held 3.566s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-c1566108-392a-4a9a-bf19-0a31705bbcd6" released by "delete_snapshot" :: held 3.608s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-f3b7b46d-a53a-41dd-beed-c18684cd47e1" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-f3b7b46d-a53a-41dd-beed-c18684cd47e1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Deleting offline snapshot f3b7b46d-a53a-41dd-beed-c18684cd47e1 of volume 7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] snapshot_file for this snap is: volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6e1b0f-4d2e-421f-aab2-c2be0e54065c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:56 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 Sep 01 23:54:56 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:56 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1" returned: 0 in 0.475s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[037e6182-0b49-4ca3-bd8d-66ba5166e6e9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:54:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:57 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 Sep 01 23:54:57 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:57 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" returned: 0 in 0.641s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:57 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 Sep 01 23:54:57 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:58 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1" returned: 0 in 0.687s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:58 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1 Sep 01 23:54:58 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Flow 'volume_create_manager' (a7a86680-4fcb-4de0-b284-df89e21e8c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92cce46-609e-4c9a-8da6-7e70f789e4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92cce46-609e-4c9a-8da6-7e70f789e4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1602358825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc3d964-96e9-48b1-9006-a552719c6403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a1a319a9a740b2bfe5141f14e72737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:54:58Z,use_quota=True,user_id='f10650f35cb24c3eb2cb46d9452d95f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf56f63c-05da-4e2f-9cab-9f22508993ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf56f63c-05da-4e2f-9cab-9f22508993ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063c60e5-3a8d-438f-85a2-653c782eb326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063c60e5-3a8d-438f-85a2-653c782eb326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc3d964-96e9-48b1-9006-a552719c6403', 'volume_name': 'volume-6fc3d964-96e9-48b1-9006-a552719c6403', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1a5322-27f7-4f43-841f-f210b919d407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1a5322-27f7-4f43-841f-f210b919d407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de797ed-8464-45bf-ab35-4a251ec4218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Volume 6fc3d964-96e9-48b1-9006-a552719c6403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc3d964-96e9-48b1-9006-a552719c6403', 'volume_size': 1} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1602358825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc3d964-96e9-48b1-9006-a552719c6403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a1a319a9a740b2bfe5141f14e72737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:54:58Z,use_quota=True,user_id='f10650f35cb24c3eb2cb46d9452d95f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Creating volume 6fc3d964-96e9-48b1-9006-a552719c6403 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:54:58 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:58 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677.f3b7b46d-a53a-41dd-beed-c18684cd47e1" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:58 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403 1073741824 Sep 01 23:54:58 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-f3b7b46d-a53a-41dd-beed-c18684cd47e1" released by "_delete_snapshot" :: held 2.335s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" released by "delete_snapshot" :: held 2.368s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:54:58 devstack cinder-volume[86591]: WARNING cinder.quota [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-786629030 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-786629030, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:54:58 devstack cinder-volume[86591]: WARNING cinder.quota [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-786629030 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-786629030, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:54:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['a9eca9de-e1b7-482e-812f-8b8d872a2aa3', '3c371b20-672c-4503-8da9-4adb76a29614', 'ceaa23cb-111d-4f1e-bf9a-27c0ae9b69f1', 'ce6cc0b3-1171-498d-9639-683f1bfaed87'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['5235e63a-0990-468c-8926-210034d7b382', '337cfe4d-429d-4c29-86c6-645defd18fab', '70d63108-a23e-4a71-aa79-27212f39bb31', '5e8eb6c7-eeba-4b46-82db-edbc3521b1f3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:54:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c42fae7d-b847-4ba3-9c72-6667f81567f4 tempest-GroupSnapshotsTest-1992265274 None] group_snapshot 4d450642-43eb-4a77-997b-ba7ea4414e16: deleted successfully Sep 01 23:54:59 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403 1073741824" returned: 0 in 0.574s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:54:59 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403 Sep 01 23:54:59 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:54:59 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403" returned: 0 in 0.264s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de797ed-8464-45bf-ab35-4a251ec4218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc3d964-96e9-48b1-9006-a552719c6403', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8cc8f8-d76e-4ec8-9ee9-5accb3d2c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:54:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Volume volume-6fc3d964-96e9-48b1-9006-a552719c6403 (6fc3d964-96e9-48b1-9006-a552719c6403): created successfully Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8cc8f8-d76e-4ec8-9ee9-5accb3d2c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:54:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Flow 'volume_create_manager' (a7a86680-4fcb-4de0-b284-df89e21e8c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:54:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4aa83cd6-b4e4-4df9-9683-668e91ec71c7 tempest-VolumesAdminNegativeTest-980801224 None] Created volume successfully. Sep 01 23:55:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6c8222c-6612-420e-9dc0-a0de8d812deb tempest-BackendsCapabilitiesAdminTestsJSON-1263685675 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8815231323242, 'free_capacity_gb': 1773.8815231323242, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 23:55:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-45708963-0062-4a3c-8a43-cd35083c01a4 tempest-BackendsCapabilitiesAdminTestsJSON-1263685675 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8815231323242, 'free_capacity_gb': 1773.8815231323242, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 23:55:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb162fd-caa4-4930-a310-0f865f1dc648]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:00 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 Sep 01 23:55:00 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:00 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" returned: 0 in 0.434s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:00 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677 Sep 01 23:55:00 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:01 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" returned: 0 in 0.337s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-7a2e5bed-08d8-4ae8-b9ff-84a1c2e07677" released by "delete_volume" :: held 0.870s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-c1566108-392a-4a9a-bf19-0a31705bbcd6" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-c1566108-392a-4a9a-bf19-0a31705bbcd6" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Acquiring lock "cinder-6fc3d964-96e9-48b1-9006-a552719c6403-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f811aac-8266-404a-bde3-a65bbfe748ca]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Lock "cinder-6fc3d964-96e9-48b1-9006-a552719c6403-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Acquiring lock "cinder-quobyte-6fc3d964-96e9-48b1-9006-a552719c6403" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Lock "cinder-quobyte-6fc3d964-96e9-48b1-9006-a552719c6403" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:01 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aca038-62f7-4bc2-ac3c-3dccdff2eda3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:01 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:01 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403 Sep 01 23:55:01 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:01 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6" returned: 0 in 0.554s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:02 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6 Sep 01 23:55:02 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:02 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403" returned: 0 in 0.546s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:02 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403 Sep 01 23:55:02 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:02 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1566108-392a-4a9a-bf19-0a31705bbcd6" returned: 0 in 0.337s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-c1566108-392a-4a9a-bf19-0a31705bbcd6" released by "delete_volume" :: held 0.980s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['3882b1de-330f-4424-a96c-f2b0dd000d41'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:02 devstack cinder-volume[86591]: WARNING cinder.quota [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-786629030 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-786629030, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:55:02 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6fc3d964-96e9-48b1-9006-a552719c6403" returned: 0 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Lock "cinder-quobyte-6fc3d964-96e9-48b1-9006-a552719c6403" released by "delete_volume" :: held 1.022s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['2e972fd5-ff15-4d22-9e82-cfa7192ed3d1', 'f3471a54-5f0e-427e-a052-e7627c359a5c', '95e2b9a4-4c8c-4f42-b3c9-820b19d36402', '79f81d1c-cdec-4f95-8153-712190355b19'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Created reservations ['47c8b83a-5981-452f-be84-edc6944ae0cb', '5d5f53dd-ebf4-4ed4-91ea-341e3f6b96d9', 'a7cf4361-7040-43dd-b0bb-17c38c4e9a30', 'e92d433b-63fc-4b05-930f-0cfc06426fce'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:02 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:55:02 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['4f95eed1-65b2-44cf-ae94-4de5797864dc', '857c8ac1-0c65-4290-bcea-e21913dfe57e', '1f3ccffb-437d-4ea1-8c8d-d57f74a9333c', '6e659016-3195-4250-9b9c-371f4b7e85e8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:03 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:55:03 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:03 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.311s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:03 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:55:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Deleted volume successfully. Sep 01 23:55:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd55ea79-cf08-45c9-999b-b03954760c3f tempest-VolumesAdminNegativeTest-980801224 None] Lock "cinder-6fc3d964-96e9-48b1-9006-a552719c6403-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:03 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.619s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:03 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:55:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-83d0b508-63b0-48ab-8569-27496b47ae61 tempest-GroupSnapshotsTest-1992265274 None] Delete group completed successfully. Sep 01 23:55:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-78984564-50a1-4e5f-8b75-c566fdccee0a tempest-GroupSnapshotsTest-1992265274 None] Group tempest-GroupSnapshotsTest-Group-1184192890: creating Sep 01 23:55:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-78984564-50a1-4e5f-8b75-c566fdccee0a tempest-GroupSnapshotsTest-1992265274 None] Group tempest-GroupSnapshotsTest-Group-1184192890: created successfully Sep 01 23:55:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-78984564-50a1-4e5f-8b75-c566fdccee0a tempest-GroupSnapshotsTest-1992265274 None] Create group completed successfully. Sep 01 23:55:05 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Flow 'volume_create_manager' (86b6e81b-c957-4187-9271-97f64a632fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e99c58-2cde-4b79-ba1d-3cb3b19327a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e99c58-2cde-4b79-ba1d-3cb3b19327a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-443187360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d73ffadf-0ed8-4300-abe9-d1e6ba656450,host='devstack@QuobyteHD#QuobyteHD',id=69fbeb32-caf8-437a-8910-c561f6adf970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3ac48ad68434f863acc0b61fba08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:06Z,use_quota=True,user_id='a947f394fd4543d8b1ae5a1e0a6c7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b31fc7ed-5f3d-416f-8619-18c7402c601e),volume_type_id=b31fc7ed-5f3d-416f-8619-18c7402c601e)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cd96c7-63ef-4a1e-a210-5b764a0cd321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cd96c7-63ef-4a1e-a210-5b764a0cd321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565c5b70-38b8-40f4-82d0-adb13b00e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565c5b70-38b8-40f4-82d0-adb13b00e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fbeb32-caf8-437a-8910-c561f6adf970', 'volume_name': 'volume-69fbeb32-caf8-437a-8910-c561f6adf970', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed79a26-084c-4d5e-8071-d486b98d9bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed79a26-084c-4d5e-8071-d486b98d9bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff460b5b-c684-43dd-b65c-6b3ce40aa87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Volume 69fbeb32-caf8-437a-8910-c561f6adf970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fbeb32-caf8-437a-8910-c561f6adf970', 'volume_size': 1} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d73ffadf-0ed8-4300-abe9-d1e6ba656450,created_at=2026-09-01T21:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-443187360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d73ffadf-0ed8-4300-abe9-d1e6ba656450,host='devstack@QuobyteHD#QuobyteHD',id=69fbeb32-caf8-437a-8910-c561f6adf970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3ac48ad68434f863acc0b61fba08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:06Z,use_quota=True,user_id='a947f394fd4543d8b1ae5a1e0a6c7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b31fc7ed-5f3d-416f-8619-18c7402c601e),volume_type_id=b31fc7ed-5f3d-416f-8619-18c7402c601e)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Creating volume 69fbeb32-caf8-437a-8910-c561f6adf970 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:55:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:06 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 1073741824 Sep 01 23:55:06 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:06 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:55:06 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:06 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 1073741824" returned: 0 in 0.636s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:06 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.386s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:55:06 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 Sep 01 23:55:06 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:07 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970" returned: 0 in 0.296s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:55:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff460b5b-c684-43dd-b65c-6b3ce40aa87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fbeb32-caf8-437a-8910-c561f6adf970', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cc7760-716b-491e-8c05-3ede08b648b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Volume volume-69fbeb32-caf8-437a-8910-c561f6adf970 (69fbeb32-caf8-437a-8910-c561f6adf970): created successfully Sep 01 23:55:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cc7760-716b-491e-8c05-3ede08b648b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Flow 'volume_create_manager' (86b6e81b-c957-4187-9271-97f64a632fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:55:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9d43d5ee-3cf9-4051-9f05-a977457408e4 tempest-GroupSnapshotsTest-1992265274 None] Created volume successfully. Sep 01 23:55:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cd466e1d-2545-4da3-97d7-e93655c6d2ab tempest-GroupsV314Test-335915934 None] Group tempest-GroupsV314Test-Group-561003311: creating Sep 01 23:55:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cd466e1d-2545-4da3-97d7-e93655c6d2ab tempest-GroupsV314Test-335915934 None] Group tempest-GroupsV314Test-Group-561003311: created successfully Sep 01 23:55:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cd466e1d-2545-4da3-97d7-e93655c6d2ab tempest-GroupsV314Test-335915934 None] Create group completed successfully. Sep 01 23:55:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] GroupSnapshot daf08cea-5f02-4f42-ab24-f96ccbe36cfc: creating. Sep 01 23:55:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Group snapshot daf08cea-5f02-4f42-ab24-f96ccbe36cfc: creating. {{(pid=86591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 23:55:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Creating offline snapshot 2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 of volume 69fbeb32-caf8-437a-8910-c561f6adf970 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:55:08 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f308e-17ef-47f5-b88c-606cf628d4fb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:08 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 Sep 01 23:55:08 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:09 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970" returned: 0 in 0.399s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:09 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 1G Sep 01 23:55:09 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:09 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 1G" returned: 0 in 0.565s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69fbeb32-caf8-437a-8910-c561f6adf970 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:09 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69fbeb32-caf8-437a-8910-c561f6adf970 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 Sep 01 23:55:09 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:10 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69fbeb32-caf8-437a-8910-c561f6adf970 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91" returned: 0 in 0.469s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:10 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=117,cinder:UPDATE=103,cinder:INSERT=26,cinder:DELETE=2 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:55:10 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 Sep 01 23:55:10 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=116,cinder:UPDATE=106,cinder:INSERT=20,cinder:DELETE=4 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Flow 'volume_create_manager' (575d59bd-df33-4a78-8336-c4447e5cb3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074398d3-48ba-40e7-b0fc-e8f953729612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074398d3-48ba-40e7-b0fc-e8f953729612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-183289416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c779dd7-f449-4536-bb63-530ad2663a3d,host='devstack@QuobyteHD#QuobyteHD',id=5725d1b5-8c93-45fb-aed3-d53a639726cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539708d50b8843dfbe7e3f885d508127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:10Z,use_quota=True,user_id='192b2fd7b24a4446b683eef889ec32e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5254d03d-d3de-45d8-8f4b-7250ce83aae6),volume_type_id=5254d03d-d3de-45d8-8f4b-7250ce83aae6)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a45f269-ddf8-446e-af76-a870fd25fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a45f269-ddf8-446e-af76-a870fd25fd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd701f9f-87a8-4721-9069-e2d5860733b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd701f9f-87a8-4721-9069-e2d5860733b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5725d1b5-8c93-45fb-aed3-d53a639726cf', 'volume_name': 'volume-5725d1b5-8c93-45fb-aed3-d53a639726cf', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0946a6-60c0-4fda-9cfc-ccfe0538de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0946a6-60c0-4fda-9cfc-ccfe0538de7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cada3a4-6825-4f8f-8630-d3fe736bb531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Volume 5725d1b5-8c93-45fb-aed3-d53a639726cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5725d1b5-8c93-45fb-aed3-d53a639726cf', 'volume_size': 1} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:10 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91" returned: 0 in 0.310s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:10 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.info Sep 01 23:55:10 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-49a5597c-645a-4112-9317-ca7286d48a1c req-cacb3542-8eca-470b-b5c6-25b4d68deeb3 tempest-ServerActionsTestOtherA-1621420664 None] Terminate volume connection completed successfully. Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-49a5597c-645a-4112-9317-ca7286d48a1c req-cacb3542-8eca-470b-b5c6-25b4d68deeb3 tempest-ServerActionsTestOtherA-1621420664 None] Deleting attachment f8f59b94-1b3e-4dfc-b48c-3e221be09ee9. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 23:55:10 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.info" returned: 0 in 0.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:10 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:55:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:10 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.info Sep 01 23:55:10 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:11 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.info" returned: 0 in 0.289s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.648s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1c779dd7-f449-4536-bb63-530ad2663a3d,created_at=2026-09-01T21:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-183289416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c779dd7-f449-4536-bb63-530ad2663a3d,host='devstack@QuobyteHD#QuobyteHD',id=5725d1b5-8c93-45fb-aed3-d53a639726cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539708d50b8843dfbe7e3f885d508127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:10Z,use_quota=True,user_id='192b2fd7b24a4446b683eef889ec32e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5254d03d-d3de-45d8-8f4b-7250ce83aae6),volume_type_id=5254d03d-d3de-45d8-8f4b-7250ce83aae6)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Creating volume 5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:55:11 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:11 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf 1073741824 Sep 01 23:55:11 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f8a2f34c-0e2c-45f4-97aa-76f2a2dd523b tempest-GroupSnapshotsTest-1992265274 None] group_snapshot daf08cea-5f02-4f42-ab24-f96ccbe36cfc: created successfully Sep 01 23:55:11 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf 1073741824" returned: 0 in 0.621s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:11 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf Sep 01 23:55:11 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:12 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf" returned: 0 in 0.498s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cada3a4-6825-4f8f-8630-d3fe736bb531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5725d1b5-8c93-45fb-aed3-d53a639726cf', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ad3650-b5aa-4a67-b7c5-e2a40ebdb8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] group_snapshot daf08cea-5f02-4f42-ab24-f96ccbe36cfc: deleting Sep 01 23:55:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Volume volume-5725d1b5-8c93-45fb-aed3-d53a639726cf (5725d1b5-8c93-45fb-aed3-d53a639726cf): created successfully Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ad3650-b5aa-4a67-b7c5-e2a40ebdb8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Flow 'volume_create_manager' (575d59bd-df33-4a78-8336-c4447e5cb3ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] group_snapshot daf08cea-5f02-4f42-ab24-f96ccbe36cfc: deleting {{(pid=86591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 23:55:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c41b0ae0-ccb8-427a-90bc-5ea41dd5516b tempest-GroupsV314Test-335915934 None] Created volume successfully. Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-69fbeb32-caf8-437a-8910-c561f6adf970" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-69fbeb32-caf8-437a-8910-c561f6adf970" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Deleting offline snapshot 2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 of volume 69fbeb32-caf8-437a-8910-c561f6adf970 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] snapshot_file for this snap is: volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c65ea28-b4a4-4715-9069-e0ca61ba2207]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:12 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 Sep 01 23:55:12 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:13 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91" returned: 0 in 0.561s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69fbeb32-caf8-437a-8910-c561f6adf970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ea10b-d082-4fa0-91b7-3ad213124627]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:13 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 Sep 01 23:55:13 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:13 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970" returned: 0 in 0.466s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:13 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 Sep 01 23:55:13 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:13 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Cloning volume 5725d1b5-8c93-45fb-aed3-d53a639726cf to volume a962837c-7c5c-4711-9673-c289feac9d8d Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Creating offline snapshot 97381ceb-384c-4c14-89a5-dc8db4b897a4 of volume 5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a3c37-2282-4371-98d4-8b77f417a270]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:14 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf Sep 01 23:55:14 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:14 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91" returned: 0 in 0.597s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:14 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91 Sep 01 23:55:14 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:14 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf" returned: 0 in 0.461s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:14 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 1G Sep 01 23:55:14 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:14 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970.2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91" returned: 0 in 0.435s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-2f3e7eb2-0cf8-4c00-8a0b-fa991601ed91" released by "_delete_snapshot" :: held 2.223s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-69fbeb32-caf8-437a-8910-c561f6adf970" released by "delete_snapshot" :: held 2.266s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:14 devstack cinder-volume[86591]: WARNING cinder.quota [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1974502917 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1974502917, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:55:14 devstack cinder-volume[86591]: WARNING cinder.quota [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1974502917 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1974502917, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['b1c20ec8-c139-4a12-8822-2ec6f97e7926', '2aba2ac8-b631-4241-9f91-f64d608a404e', 'eb5b3543-ada6-4890-9162-cab4ba32ce14', '4dfaa48e-5c89-48bf-8b9c-53c589e9bec5'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:14 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 1G" returned: 0 in 0.536s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5725d1b5-8c93-45fb-aed3-d53a639726cf -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:15 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5725d1b5-8c93-45fb-aed3-d53a639726cf -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 Sep 01 23:55:15 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0ed3a7fc-29da-4f2a-9e23-102ae9ee6ba9 tempest-GroupSnapshotsTest-1992265274 None] group_snapshot daf08cea-5f02-4f42-ab24-f96ccbe36cfc: deleted successfully Sep 01 23:55:15 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5725d1b5-8c93-45fb-aed3-d53a639726cf -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4" returned: 0 in 0.409s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:15 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:55:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:15 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 Sep 01 23:55:15 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:15 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4" returned: 0 in 0.359s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:15 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.info Sep 01 23:55:15 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:16 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.info" returned: 0 in 0.478s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:16 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:16 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.info Sep 01 23:55:16 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "cinder-quobyte-69fbeb32-caf8-437a-8910-c561f6adf970" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-69fbeb32-caf8-437a-8910-c561f6adf970" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[106d412c-dd18-4c03-91fc-ef8a77b4b10e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:16 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.info" returned: 0 in 0.414s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Acquiring lock "cinder-quobyte-a962837c-7c5c-4711-9673-c289feac9d8d" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Lock "cinder-quobyte-a962837c-7c5c-4711-9673-c289feac9d8d" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] snapshot: 97381ceb-384c-4c14-89a5-dc8db4b897a4, volume: a962837c-7c5c-4711-9673-c289feac9d8d, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:16 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 Sep 01 23:55:16 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0ab288-c391-412e-9d77-69fc5e156374]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:16 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 Sep 01 23:55:16 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:17 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:17 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970 Sep 01 23:55:17 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:17 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4" returned: 0 in 0.467s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5725d1b5-8c93-45fb-aed3-d53a639726cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d75879a-d5bf-484a-a5f3-8f01dcc349e8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:17 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf Sep 01 23:55:17 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:17 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-69fbeb32-caf8-437a-8910-c561f6adf970" returned: 0 in 0.320s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Lock "cinder-quobyte-69fbeb32-caf8-437a-8910-c561f6adf970" released by "delete_volume" :: held 0.991s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['cb3a12a0-d36f-444a-9b31-e3f68c9dc914'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:17 devstack cinder-volume[86591]: WARNING cinder.quota [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1974502917 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1974502917, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Created reservations ['c8d64f05-64ee-49e2-8f9e-e1f605931625', '513ff144-cf33-483d-ae45-f9ddd3cfbe94', 'cbad627b-d096-4348-a49e-ef09c59d1779', '87086005-0c15-41a0-b61b-0c020433f200'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:17 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf" returned: 0 in 0.507s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:17 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d Sep 01 23:55:17 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:17 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:55:17 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:18 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.423s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:18 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:55:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f64402c0-90be-4941-916f-9fd95d363325 tempest-GroupSnapshotsTest-1992265274 None] Delete group completed successfully. Sep 01 23:55:19 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:55:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Flow 'volume_create_manager' (f100297d-9b84-46f4-91d2-0a0041c38c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:55:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ec5c90-b83e-4577-ab8d-c667bc0eb76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ec5c90-b83e-4577-ab8d-c667bc0eb76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-977564478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a5e773-6a8f-4e70-862c-f840c5bd90a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='644ed24fbd3e4961af86fa92422a822e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:19Z,use_quota=True,user_id='95085ed24b474d04ad87aa286666e6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75eeec8-2db6-43b7-aca4-33ab2b4905cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75eeec8-2db6-43b7-aca4-33ab2b4905cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45298636-d8bb-43e4-bb91-3661317c3155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:19 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 23:55:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45298636-d8bb-43e4-bb91-3661317c3155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04a5e773-6a8f-4e70-862c-f840c5bd90a0', 'volume_name': 'volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dfa222-0b0d-4ceb-b485-f5b622b6b04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dfa222-0b0d-4ceb-b485-f5b622b6b04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ded046-661d-4b05-ab29-8dfc58017a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Volume 04a5e773-6a8f-4e70-862c-f840c5bd90a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 23:55:20 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Trying to clone 04a5e773-6a8f-4e70-862c-f840c5bd90a0 from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 23:55:21 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD, size 20.69 MB, duration 1.13 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 23:55:21 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Image download 20.69 MB at 18.37 MB/s Sep 01 23:55:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7577996-0eab-4a57-91d1-37a9ff8b7db0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:21 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD Sep 01 23:55:21 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:22 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD" returned: 0 in 1.254s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:22 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 is fetched for user 95085ed24b474d04ad87aa286666e6eb. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 23:55:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a66c2d-86aa-4704-9df6-9d2e36534577]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:23 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD Sep 01 23:55:23 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:23 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:24 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d" returned: 0 in 6.331s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 23:55:24 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Converted 1024.00 MB image at 161.71 MB/s Sep 01 23:55:24 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:24 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d Sep 01 23:55:24 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:24 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Lock "cinder-quobyte-a962837c-7c5c-4711-9673-c289feac9d8d" released by "_copy_volume_from_snapshot" :: held 7.697s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Acquiring lock "cinder-quobyte-97381ceb-384c-4c14-89a5-dc8db4b897a4" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Lock "cinder-quobyte-97381ceb-384c-4c14-89a5-dc8db4b897a4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Deleting offline snapshot 97381ceb-384c-4c14-89a5-dc8db4b897a4 of volume 5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] snapshot_file for this snap is: volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad60f241-c4dc-493f-8ee1-087faeca9164]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:24 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 Sep 01 23:55:24 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:24 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4" returned: 0 in 0.399s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5725d1b5-8c93-45fb-aed3-d53a639726cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:55:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[935bf172-61cd-4eba-a8d3-14806e8e16c2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:25 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf Sep 01 23:55:25 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:25 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf" returned: 0 in 0.609s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:25 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 Sep 01 23:55:25 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:25 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4" returned: 0 in 0.375s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:26 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4 Sep 01 23:55:26 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:26 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf.97381ceb-384c-4c14-89a5-dc8db4b897a4" returned: 0 in 0.260s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Lock "cinder-quobyte-97381ceb-384c-4c14-89a5-dc8db4b897a4" released by "_delete_snapshot" :: held 1.780s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.434s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.634s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-977564478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a5e773-6a8f-4e70-862c-f840c5bd90a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='644ed24fbd3e4961af86fa92422a822e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:19Z,use_quota=True,user_id='95085ed24b474d04ad87aa286666e6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Creating volume 04a5e773-6a8f-4e70-862c-f840c5bd90a0 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:55:26 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:26 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 1073741824 Sep 01 23:55:26 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-14b9514b-2052-4022-9ce1-3089893ccfd3 tempest-GroupsV314Test-335915934 None] Create group from source-group-1c779dd7-f449-4536-bb63-530ad2663a3d completed successfully. Sep 01 23:55:26 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 1073741824" returned: 0 in 0.652s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:27 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 Sep 01 23:55:27 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Acquiring lock "cinder-quobyte-a962837c-7c5c-4711-9673-c289feac9d8d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Lock "cinder-quobyte-a962837c-7c5c-4711-9673-c289feac9d8d" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db60848-1866-4a0e-b302-d1a6ef8e4ea2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:27 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:27 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d Sep 01 23:55:27 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Attempting download of 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume 04a5e773-6a8f-4e70-862c-f840c5bd90a0. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6539e8c-c258-4c8d-90e8-9d5c3e514016]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_y_3zplku {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:27 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_y_3zplku Sep 01 23:55:27 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:27 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:27 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d Sep 01 23:55:27 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_y_3zplku" returned: 0 in 0.418s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_y_3zplku {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:27 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:28 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_y_3zplku Sep 01 23:55:28 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:28 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a962837c-7c5c-4711-9673-c289feac9d8d" returned: 0 in 0.384s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Lock "cinder-quobyte-a962837c-7c5c-4711-9673-c289feac9d8d" released by "delete_volume" :: held 0.915s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Created reservations ['c81a90bb-f9f0-42cb-9ea9-0a64c2273174'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:28 devstack cinder-volume[86591]: WARNING cinder.quota [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-883781139 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-883781139, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:55:28 devstack cinder-volume[86591]: WARNING cinder.quota [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-883781139 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-883781139, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Created reservations ['87a30413-be50-4a94-9319-aa4fe78ea44e', '9d6fef74-a3f7-43ce-b72e-f72b0e62284e', 'b7d0b44e-80ab-42bf-ac8d-003ed79e9c4f', '67293d2f-ac8f-4607-bd45-684c1c89e604'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:28 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_y_3zplku" returned: 1 in 0.468s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_y_3zplku' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585e891-4cd0-4be9-89f3-01c67c184d97]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:28 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD Sep 01 23:55:28 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:28 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:55:28 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:28 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] 7ac8008a-9a50-4a29-8129-58d061cbfda5 was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:28 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 Sep 01 23:55:28 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b09ca4ea-f67d-4cd8-a29f-d8a72dff14f0 tempest-GroupSnapshotsV319Test-469568768 None] Group tempest-GroupSnapshotsV319Test-Group-1045279829: creating Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Acquiring lock "cinder-quobyte-5725d1b5-8c93-45fb-aed3-d53a639726cf" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:28 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:55:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Lock "cinder-quobyte-5725d1b5-8c93-45fb-aed3-d53a639726cf" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b09ca4ea-f67d-4cd8-a29f-d8a72dff14f0 tempest-GroupSnapshotsV319Test-469568768 None] Group tempest-GroupSnapshotsV319Test-Group-1045279829: created successfully Sep 01 23:55:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-23bed4e6-1495-44b5-92a6-f56717f4c206 tempest-GroupsV314Test-335915934 None] Delete group completed successfully. Sep 01 23:55:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b09ca4ea-f67d-4cd8-a29f-d8a72dff14f0 tempest-GroupSnapshotsV319Test-469568768 None] Create group completed successfully. Sep 01 23:55:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8b4203-df5e-4fa5-a80b-52e7b29d21d2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:29 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf Sep 01 23:55:29 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:29 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:29 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf Sep 01 23:55:29 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:29 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5725d1b5-8c93-45fb-aed3-d53a639726cf" returned: 0 in 0.318s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Lock "cinder-quobyte-5725d1b5-8c93-45fb-aed3-d53a639726cf" released by "delete_volume" :: held 0.871s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:29 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Created reservations ['25e293b3-b09d-4841-b01c-6b4e46978549'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:29 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Created reservations ['8b37afdf-420a-448d-a8c1-0adb9c4f0277', 'f5bcc552-8022-467b-8a29-c11d05a1b914', '5034a18c-b5c5-4235-8eb0-92fe504a542b', 'e8cedb3e-f9d9-4eb7-bd4c-13ecf98e8112'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:30 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:55:30 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:30 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.406s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:55:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-13c6daee-1f6d-4c51-a46e-4af209538d4d tempest-GroupsV314Test-335915934 None] Delete group completed successfully. Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Flow 'volume_create_manager' (95075fb2-eb58-4a7b-9e55-4020037e223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e02cdd8-4023-48af-9be9-3f43b388af35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e02cdd8-4023-48af-9be9-3f43b388af35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-784286119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6722b707-8299-4e78-b011-1092b4ec551e,host='devstack@QuobyteHD#QuobyteHD',id=e5054f51-313a-4b2f-9bb3-8aa990f6a015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc36d6b2ae8745e1b192080ae1f30265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:31Z,use_quota=True,user_id='f0d3c5e237cd4209a9e8f19ced72d1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb0778c8-7543-495b-b887-9a4054fa8d10),volume_type_id=cb0778c8-7543-495b-b887-9a4054fa8d10)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a4a808-86a1-4d33-a900-303d95e039e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a4a808-86a1-4d33-a900-303d95e039e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d80022-5d79-4a83-8b9c-c032b477f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d80022-5d79-4a83-8b9c-c032b477f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5054f51-313a-4b2f-9bb3-8aa990f6a015', 'volume_name': 'volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a123e4-a434-409a-aca3-5ebd0bbfb694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a123e4-a434-409a-aca3-5ebd0bbfb694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef38b3c3-fb99-4c16-9238-139f9469e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:31 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Volume e5054f51-313a-4b2f-9bb3-8aa990f6a015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015', 'volume_size': 1} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6722b707-8299-4e78-b011-1092b4ec551e,created_at=2026-09-01T21:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-784286119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6722b707-8299-4e78-b011-1092b4ec551e,host='devstack@QuobyteHD#QuobyteHD',id=e5054f51-313a-4b2f-9bb3-8aa990f6a015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc36d6b2ae8745e1b192080ae1f30265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:31Z,use_quota=True,user_id='f0d3c5e237cd4209a9e8f19ced72d1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb0778c8-7543-495b-b887-9a4054fa8d10),volume_type_id=cb0778c8-7543-495b-b887-9a4054fa8d10)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Creating volume e5054f51-313a-4b2f-9bb3-8aa990f6a015 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:55:31 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:31 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 1073741824 Sep 01 23:55:31 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:31 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0" returned: 0 in 2.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_2kz5s5htdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 23:55:31 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Converted 112.00 MB image at 46.53 MB/s Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:31 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 1G Sep 01 23:55:31 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:31 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 1073741824" returned: 0 in 0.575s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:31 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 1G" returned: 0 in 0.440s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Downloaded image 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume 04a5e773-6a8f-4e70-862c-f840c5bd90a0 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 for user 95085ed24b474d04ad87aa286666e6eb is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Marking volume 04a5e773-6a8f-4e70-862c-f840c5bd90a0 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Copying metadata from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 to 04a5e773-6a8f-4e70-862c-f840c5bd90a0. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Creating volume glance metadata for volume 04a5e773-6a8f-4e70-862c-f840c5bd90a0 backed by image 7ac8008a-9a50-4a29-8129-58d061cbfda5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:31 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 Sep 01 23:55:31 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ded046-661d-4b05-ab29-8dfc58017a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5a2232-9d09-41b4-8a98-a94214ef7b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:31 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Volume volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 (04a5e773-6a8f-4e70-862c-f840c5bd90a0): created successfully Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5a2232-9d09-41b4-8a98-a94214ef7b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Flow 'volume_create_manager' (f100297d-9b84-46f4-91d2-0a0041c38c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:55:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cdfb78ee-f996-4ac7-96be-3922ddce0658 tempest-ServerActionsTestOtherA-1621420664 None] Created volume successfully. Sep 01 23:55:32 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015" returned: 0 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:55:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef38b3c3-fb99-4c16-9238-139f9469e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f6cc1e-e058-4b3a-b197-043501e30c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:32 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Volume volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 (e5054f51-313a-4b2f-9bb3-8aa990f6a015): created successfully Sep 01 23:55:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f6cc1e-e058-4b3a-b197-043501e30c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Flow 'volume_create_manager' (95075fb2-eb58-4a7b-9e55-4020037e223d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:55:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-72d21c79-2fad-411e-b38f-e8acf0ec8846 tempest-GroupSnapshotsV319Test-469568768 None] Created volume successfully. Sep 01 23:55:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] GroupSnapshot 45a5fea4-dbdb-4488-97b0-8fb737893448: creating. Sep 01 23:55:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Group snapshot 45a5fea4-dbdb-4488-97b0-8fb737893448: creating. {{(pid=86591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 23:55:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Creating offline snapshot ef9b4efd-c3a3-4426-9199-47dff863ddbe of volume e5054f51-313a-4b2f-9bb3-8aa990f6a015 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:55:33 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23b7795-259e-45d1-892e-979adcd1c7cc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:33 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 Sep 01 23:55:33 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:34 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015" returned: 0 in 0.499s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:34 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe 1G Sep 01 23:55:34 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:34 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe 1G" returned: 0 in 0.615s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:34 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe Sep 01 23:55:34 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:35 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:35 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:55:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:35 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe Sep 01 23:55:35 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:35 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:35 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.info Sep 01 23:55:35 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:36 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.info" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:36 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 23:55:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:36 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.info Sep 01 23:55:36 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-14a34db0-00f0-4913-8806-a4bfc06f30a4 req-d3bb5f2a-ee6c-4480-a6b8-094e3afb5e02 tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:36 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.info" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-14a34db0-00f0-4913-8806-a4bfc06f30a4 req-d3bb5f2a-ee6c-4480-a6b8-094e3afb5e02 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.279s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-14a34db0-00f0-4913-8806-a4bfc06f30a4 req-d3bb5f2a-ee6c-4480-a6b8-094e3afb5e02 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-14a34db0-00f0-4913-8806-a4bfc06f30a4 req-d3bb5f2a-ee6c-4480-a6b8-094e3afb5e02 tempest-ServerActionsTestOtherA-1621420664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0df002e8-18c2-4a2d-b4f4-d43208621863', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 23:55:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-49b42348-8665-4f15-89a9-943b89f7a842 tempest-GroupSnapshotsV319Test-469568768 None] group_snapshot 45a5fea4-dbdb-4488-97b0-8fb737893448: created successfully Sep 01 23:55:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-14a34db0-00f0-4913-8806-a4bfc06f30a4 req-d3bb5f2a-ee6c-4480-a6b8-094e3afb5e02 tempest-ServerActionsTestOtherA-1621420664 None] attachment_update completed successfully. Sep 01 23:55:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] group_snapshot 45a5fea4-dbdb-4488-97b0-8fb737893448: deleting Sep 01 23:55:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] group_snapshot 45a5fea4-dbdb-4488-97b0-8fb737893448: deleting {{(pid=86591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 23:55:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Acquiring lock "cinder-quobyte-e5054f51-313a-4b2f-9bb3-8aa990f6a015" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Lock "cinder-quobyte-e5054f51-313a-4b2f-9bb3-8aa990f6a015" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Acquiring lock "cinder-quobyte-ef9b4efd-c3a3-4426-9199-47dff863ddbe" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Lock "cinder-quobyte-ef9b4efd-c3a3-4426-9199-47dff863ddbe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Deleting offline snapshot ef9b4efd-c3a3-4426-9199-47dff863ddbe of volume e5054f51-313a-4b2f-9bb3-8aa990f6a015 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:55:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] snapshot_file for this snap is: volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:55:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1792684d-7643-4c79-b576-4f0a3c85f7c1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:37 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe Sep 01 23:55:37 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-37442fa9-4774-4ad6-8020-0c00cd5c4a13 tempest-GroupsV320Test-1930653001 None] Group tempest-GroupsV320Test-Group-106756438: creating Sep 01 23:55:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-37442fa9-4774-4ad6-8020-0c00cd5c4a13 tempest-GroupsV320Test-1930653001 None] Group tempest-GroupsV320Test-Group-106756438: created successfully Sep 01 23:55:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-37442fa9-4774-4ad6-8020-0c00cd5c4a13 tempest-GroupsV320Test-1930653001 None] Create group completed successfully. Sep 01 23:55:38 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe" returned: 0 in 0.508s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:55:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[589972e4-5a3a-4744-9142-389e5eb54246]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:38 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 Sep 01 23:55:38 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:38 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015" returned: 0 in 0.420s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:38 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe Sep 01 23:55:38 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:39 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:39 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe Sep 01 23:55:39 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:39 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015.ef9b4efd-c3a3-4426-9199-47dff863ddbe" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Lock "cinder-quobyte-ef9b4efd-c3a3-4426-9199-47dff863ddbe" released by "_delete_snapshot" :: held 1.854s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Lock "cinder-quobyte-e5054f51-313a-4b2f-9bb3-8aa990f6a015" released by "delete_snapshot" :: held 1.889s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:39 devstack cinder-volume[86591]: WARNING cinder.quota [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1986359809 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1986359809, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:55:39 devstack cinder-volume[86591]: WARNING cinder.quota [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1986359809 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1986359809, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] Created reservations ['72904aee-cab1-4765-af61-1db66760a46c', '6461eb24-dc8e-4f3e-a7b8-dc5b5ab3e3d1', 'aee99683-9dd3-42b2-bbb9-707cd049e34d', 'a39e2564-6cd7-4ff0-9648-5894db15ee71'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] Created reservations ['e08e5b76-070b-4b31-9a22-210ca6706d82'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a04c2f29-29fc-47e8-92c4-7c8357abf5c2 tempest-GroupSnapshotsV319Test-469568768 None] group_snapshot 45a5fea4-dbdb-4488-97b0-8fb737893448: deleted successfully Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:39 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:55:39 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:40 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.461s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:40 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:55:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e68081d0-28eb-4848-9109-6b05c0a38fa4 tempest-GroupsV320Test-1930653001 None] Delete group completed successfully. Sep 01 23:55:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Acquiring lock "cinder-quobyte-e5054f51-313a-4b2f-9bb3-8aa990f6a015" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:55:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Lock "cinder-quobyte-e5054f51-313a-4b2f-9bb3-8aa990f6a015" acquired by "delete_volume" :: waited 0.040s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:55:40 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c754b6fb-bf23-48d0-a0da-9111a0d00517]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:55:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:40 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 Sep 01 23:55:40 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:41 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015" returned: 0 in 0.784s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:41 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015 Sep 01 23:55:41 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:41 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5054f51-313a-4b2f-9bb3-8aa990f6a015" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Lock "cinder-quobyte-e5054f51-313a-4b2f-9bb3-8aa990f6a015" released by "delete_volume" :: held 1.365s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Created reservations ['e86dd92d-1d8d-497c-b6f3-3862d0d9ccb6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:42 devstack cinder-volume[86591]: WARNING cinder.quota [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1986359809 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1986359809, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Created reservations ['cd9cddc2-62dc-4e39-a066-13bd903318ee', '3fcd334b-1fd4-4586-a1f3-3fff1120c7f7', 'e2b96b5e-3334-4056-9477-0154456fde93', '58c7d36c-9b46-4fa3-bd75-4572d6fafc79'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:42 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:55:42 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:55:42 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.535s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:55:42 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:55:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6be6933c-3d79-4ea1-a54f-b77bb4996a86 tempest-GroupSnapshotsV319Test-469568768 None] Delete group completed successfully. Sep 01 23:55:52 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=98,cinder:UPDATE=87,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:55:52 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=86,cinder:INSERT=32,cinder:UPDATE=71,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:55:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-50d83540-c818-4086-a9f7-066d0a200e8a tempest-GroupsTest-2087157809 None] Group tempest-Group1-1106478601: creating Sep 01 23:55:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-50d83540-c818-4086-a9f7-066d0a200e8a tempest-GroupsTest-2087157809 None] Group tempest-Group1-1106478601: created successfully Sep 01 23:55:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-50d83540-c818-4086-a9f7-066d0a200e8a tempest-GroupsTest-2087157809 None] Create group completed successfully. Sep 01 23:55:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d28bcab3-0608-4f7d-8ab2-02c8b5bf6fed tempest-GroupsTest-2087157809 None] Group tempest-Group2-1784828774: creating Sep 01 23:55:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d28bcab3-0608-4f7d-8ab2-02c8b5bf6fed tempest-GroupsTest-2087157809 None] Group tempest-Group2-1784828774: created successfully Sep 01 23:55:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d28bcab3-0608-4f7d-8ab2-02c8b5bf6fed tempest-GroupsTest-2087157809 None] Create group completed successfully. Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Flow 'volume_create_manager' (d5bc9217-9aaa-4bf4-9cfc-5c7439daa4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb95485-9066-4e3c-a379-37f84fdf456e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb95485-9066-4e3c-a379-37f84fdf456e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1973934159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21d80a6d-030e-4d37-8d5a-e48da7f135c2,host='devstack@QuobyteHD#QuobyteHD',id=4a9e527a-9932-47af-8c43-ffd0194429ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789ee8e4b3c6423b9891521ec0dafd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:59Z,use_quota=True,user_id='9009dfecd6d94b8b95a09d47c004537f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4192be0-7503-46e4-986b-ad3dcf98f81e),volume_type_id=d4192be0-7503-46e4-986b-ad3dcf98f81e)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8194bfd-082e-49ce-b452-7aa154a4eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8194bfd-082e-49ce-b452-7aa154a4eaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4edeb2-1abd-4f63-9d11-f1f8d0d76a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4edeb2-1abd-4f63-9d11-f1f8d0d76a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9e527a-9932-47af-8c43-ffd0194429ff', 'volume_name': 'volume-4a9e527a-9932-47af-8c43-ffd0194429ff', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a4aecd-46d6-4193-836f-d5ecdfaefecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a4aecd-46d6-4193-836f-d5ecdfaefecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4108691-e090-4e77-ae92-8745108d5769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:55:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Volume 4a9e527a-9932-47af-8c43-ffd0194429ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9e527a-9932-47af-8c43-ffd0194429ff', 'volume_size': 1} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=21d80a6d-030e-4d37-8d5a-e48da7f135c2,created_at=2026-09-01T21:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1973934159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21d80a6d-030e-4d37-8d5a-e48da7f135c2,host='devstack@QuobyteHD#QuobyteHD',id=4a9e527a-9932-47af-8c43-ffd0194429ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789ee8e4b3c6423b9891521ec0dafd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:55:59Z,use_quota=True,user_id='9009dfecd6d94b8b95a09d47c004537f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4192be0-7503-46e4-986b-ad3dcf98f81e),volume_type_id=d4192be0-7503-46e4-986b-ad3dcf98f81e)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Creating volume 4a9e527a-9932-47af-8c43-ffd0194429ff {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:55:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:55:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:55:59 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff 1073741824 Sep 01 23:55:59 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:00 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff 1073741824" returned: 0 in 0.896s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:00 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff Sep 01 23:56:00 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:01 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff" returned: 0 in 0.540s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:56:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4108691-e090-4e77-ae92-8745108d5769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9e527a-9932-47af-8c43-ffd0194429ff', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63eb62b-37ed-4c51-a8db-dff3a1c26d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Volume volume-4a9e527a-9932-47af-8c43-ffd0194429ff (4a9e527a-9932-47af-8c43-ffd0194429ff): created successfully Sep 01 23:56:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63eb62b-37ed-4c51-a8db-dff3a1c26d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Flow 'volume_create_manager' (d5bc9217-9aaa-4bf4-9cfc-5c7439daa4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-119197a5-c31c-4a2c-ab8f-1fb1bc115f15 tempest-GroupsTest-2087157809 None] Created volume successfully. Sep 01 23:56:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Acquiring lock "cinder-quobyte-4a9e527a-9932-47af-8c43-ffd0194429ff" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Lock "cinder-quobyte-4a9e527a-9932-47af-8c43-ffd0194429ff" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c137c3-0c41-4f57-8903-3eb9ae967b9d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:56:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:03 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff Sep 01 23:56:03 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:03 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff" returned: 0 in 0.480s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:03 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff Sep 01 23:56:03 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:04 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a9e527a-9932-47af-8c43-ffd0194429ff" returned: 0 in 0.468s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Lock "cinder-quobyte-4a9e527a-9932-47af-8c43-ffd0194429ff" released by "delete_volume" :: held 1.017s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Created reservations ['ba20e814-53c0-4285-8bc2-79bd60d7e4f4'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:04 devstack cinder-volume[86591]: WARNING cinder.quota [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-100223917 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-100223917, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:56:04 devstack cinder-volume[86591]: WARNING cinder.quota [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-100223917 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-100223917, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Created reservations ['a664188b-159b-4d0d-9118-962a3950db00', '29437b87-0a71-4908-b8ba-d43832493b37', '620dcd0d-af46-4bd8-bc00-73c3ce246b83', 'ecc71f57-2649-410e-a8c9-a5c530391fd2'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:04 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:56:04 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-18586188-6a33-4745-b132-09b7fd4d3077 req-06c2aba4-2174-436e-9d67-16dce3a7c0bb tempest-ServerActionsTestOtherA-1621420664 None] Terminate volume connection completed successfully. Sep 01 23:56:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-18586188-6a33-4745-b132-09b7fd4d3077 req-06c2aba4-2174-436e-9d67-16dce3a7c0bb tempest-ServerActionsTestOtherA-1621420664 None] Deleting attachment 0df002e8-18c2-4a2d-b4f4-d43208621863. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 23:56:05 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.621s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:05 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:56:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9afc2a45-93a3-48a6-8b80-059a9ea7e433 tempest-GroupsTest-2087157809 None] Delete group completed successfully. Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] Created reservations ['8d1c6871-a3a6-4d6f-bffb-6ee322f96783'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:06 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:56:06 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:06 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:56:06 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:07 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.726s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:56:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8d32f89f-656c-4446-81d1-645e1bbbc31d tempest-GroupsTest-2087157809 None] Delete group completed successfully. Sep 01 23:56:07 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.691s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:56:07 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:56:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:56:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:56:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-06a0c308-ce38-459a-b89a-b8bbf1c06a23 tempest-GroupsTest-2087157809 None] Group tempest-GroupsTest-Group-22556799: creating Sep 01 23:56:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-06a0c308-ce38-459a-b89a-b8bbf1c06a23 tempest-GroupsTest-2087157809 None] Group tempest-GroupsTest-Group-22556799: created successfully Sep 01 23:56:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-06a0c308-ce38-459a-b89a-b8bbf1c06a23 tempest-GroupsTest-2087157809 None] Create group completed successfully. Sep 01 23:56:10 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Flow 'volume_create_manager' (3997f0d0-6d78-4117-beeb-e93f63ea3709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2099a929-cce9-4f3f-8eb5-0bb42483145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-18586188-6a33-4745-b132-09b7fd4d3077 req-34bc36a4-ebe3-425a-941d-493b28b777da tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-18586188-6a33-4745-b132-09b7fd4d3077 req-34bc36a4-ebe3-425a-941d-493b28b777da tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2099a929-cce9-4f3f-8eb5-0bb42483145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-384975396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb5b8c4a-7cc6-4a63-a97f-8af12c1fe403,host='devstack@QuobyteHD#QuobyteHD',id=19b019d1-494e-4a3b-8fa5-2f171a58629f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789ee8e4b3c6423b9891521ec0dafd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:11Z,use_quota=True,user_id='9009dfecd6d94b8b95a09d47c004537f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43bea540-c1b4-40ec-9eeb-b3f57794dace),volume_type_id=43bea540-c1b4-40ec-9eeb-b3f57794dace)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dee776-325d-414d-91a5-cddd96b32c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dee776-325d-414d-91a5-cddd96b32c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc843943-412b-49a6-b002-62e782d44962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc843943-412b-49a6-b002-62e782d44962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b019d1-494e-4a3b-8fa5-2f171a58629f', 'volume_name': 'volume-19b019d1-494e-4a3b-8fa5-2f171a58629f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de502fd5-56a0-4b85-a49b-726c742304d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de502fd5-56a0-4b85-a49b-726c742304d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5faa4be-2458-4029-827a-d0fba270a499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Volume 19b019d1-494e-4a3b-8fa5-2f171a58629f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b019d1-494e-4a3b-8fa5-2f171a58629f', 'volume_size': 1} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-18586188-6a33-4745-b132-09b7fd4d3077 req-34bc36a4-ebe3-425a-941d-493b28b777da tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.132s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb5b8c4a-7cc6-4a63-a97f-8af12c1fe403,created_at=2026-09-01T21:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-384975396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb5b8c4a-7cc6-4a63-a97f-8af12c1fe403,host='devstack@QuobyteHD#QuobyteHD',id=19b019d1-494e-4a3b-8fa5-2f171a58629f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789ee8e4b3c6423b9891521ec0dafd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:11Z,use_quota=True,user_id='9009dfecd6d94b8b95a09d47c004537f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43bea540-c1b4-40ec-9eeb-b3f57794dace),volume_type_id=43bea540-c1b4-40ec-9eeb-b3f57794dace)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Creating volume 19b019d1-494e-4a3b-8fa5-2f171a58629f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:56:11 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:11 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f 1073741824 Sep 01 23:56:11 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-18586188-6a33-4745-b132-09b7fd4d3077 req-34bc36a4-ebe3-425a-941d-493b28b777da tempest-ServerActionsTestOtherA-1621420664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48f2d535-8c61-4af8-9002-149fd7c7df11', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 23:56:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-18586188-6a33-4745-b132-09b7fd4d3077 req-34bc36a4-ebe3-425a-941d-493b28b777da tempest-ServerActionsTestOtherA-1621420664 None] attachment_update completed successfully. Sep 01 23:56:12 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f 1073741824" returned: 0 in 1.111s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:12 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f Sep 01 23:56:12 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:13 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f" returned: 0 in 0.670s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:56:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5faa4be-2458-4029-827a-d0fba270a499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b019d1-494e-4a3b-8fa5-2f171a58629f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e9b542-55c9-4152-ba1d-abe84e2a1ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:13 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Volume volume-19b019d1-494e-4a3b-8fa5-2f171a58629f (19b019d1-494e-4a3b-8fa5-2f171a58629f): created successfully Sep 01 23:56:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e9b542-55c9-4152-ba1d-abe84e2a1ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Flow 'volume_create_manager' (3997f0d0-6d78-4117-beeb-e93f63ea3709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0e2e0a80-8d73-4c2f-88bb-47ec0f868c1d tempest-GroupsTest-2087157809 None] Created volume successfully. Sep 01 23:56:15 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:56:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Flow 'volume_create_manager' (befc8a22-ec47-44c3-92c5-6c6407a876c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898e02ab-974f-4e9b-990c-fc9a48d31108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898e02ab-974f-4e9b-990c-fc9a48d31108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-19518673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb5b8c4a-7cc6-4a63-a97f-8af12c1fe403,host='devstack@QuobyteHD#QuobyteHD',id=2f45a653-5b3d-4410-9600-92c02cd742bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789ee8e4b3c6423b9891521ec0dafd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:16Z,use_quota=True,user_id='9009dfecd6d94b8b95a09d47c004537f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43bea540-c1b4-40ec-9eeb-b3f57794dace),volume_type_id=43bea540-c1b4-40ec-9eeb-b3f57794dace)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01db0110-2486-4a70-bdaf-8a5dbcbc2196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01db0110-2486-4a70-bdaf-8a5dbcbc2196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fa6b58-e725-4a28-a2dd-abd52e3db9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fa6b58-e725-4a28-a2dd-abd52e3db9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f45a653-5b3d-4410-9600-92c02cd742bc', 'volume_name': 'volume-2f45a653-5b3d-4410-9600-92c02cd742bc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c8b4dc-7702-489f-b2ef-3ade9abba89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c8b4dc-7702-489f-b2ef-3ade9abba89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266a424a-0d27-4b62-bc84-ff4ae8b9993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Volume 2f45a653-5b3d-4410-9600-92c02cd742bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f45a653-5b3d-4410-9600-92c02cd742bc', 'volume_size': 1} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb5b8c4a-7cc6-4a63-a97f-8af12c1fe403,created_at=2026-09-01T21:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-19518673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb5b8c4a-7cc6-4a63-a97f-8af12c1fe403,host='devstack@QuobyteHD#QuobyteHD',id=2f45a653-5b3d-4410-9600-92c02cd742bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789ee8e4b3c6423b9891521ec0dafd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:16Z,use_quota=True,user_id='9009dfecd6d94b8b95a09d47c004537f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43bea540-c1b4-40ec-9eeb-b3f57794dace),volume_type_id=43bea540-c1b4-40ec-9eeb-b3f57794dace)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Creating volume 2f45a653-5b3d-4410-9600-92c02cd742bc {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:56:16 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:56:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:16 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc 1073741824 Sep 01 23:56:16 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:17 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc 1073741824" returned: 0 in 1.632s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:17 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc Sep 01 23:56:17 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:18 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc" returned: 0 in 0.571s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:56:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266a424a-0d27-4b62-bc84-ff4ae8b9993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f45a653-5b3d-4410-9600-92c02cd742bc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79218dbe-12c1-4f30-b7a8-4c6a4fb81c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Volume volume-2f45a653-5b3d-4410-9600-92c02cd742bc (2f45a653-5b3d-4410-9600-92c02cd742bc): created successfully Sep 01 23:56:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79218dbe-12c1-4f30-b7a8-4c6a4fb81c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Flow 'volume_create_manager' (befc8a22-ec47-44c3-92c5-6c6407a876c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-df2089d8-4078-45c9-a610-fac2901ebc72 tempest-GroupsTest-2087157809 None] Created volume successfully. Sep 01 23:56:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-01bbbb8d-5c76-46b3-9ee6-ba0cc93bd9f4 tempest-GroupsTest-2087157809 None] Update group completed successfully. Sep 01 23:56:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-68093982-69df-47c8-a41c-9b0ccb652236 tempest-GroupsTest-2087157809 None] Update group completed successfully. Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Flow 'volume_create_manager' (263eef81-9257-4f1e-ae59-1d1e4202484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a250afe8-cbab-4cf0-9f0d-a1b836573061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a250afe8-cbab-4cf0-9f0d-a1b836573061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-896578276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac904b9c-1e09-445c-bab3-7ab91764a831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c6bc9f96e84ee4b152f3ef04efc5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:23Z,use_quota=True,user_id='88eb2572198f49b5ae033afa29586566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39a05b44-b4b0-4958-8ce7-59a1a7075ff8),volume_type_id=39a05b44-b4b0-4958-8ce7-59a1a7075ff8)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79f7826-1b12-44cf-aa4c-40614e3defa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79f7826-1b12-44cf-aa4c-40614e3defa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c939aafa-2d37-4750-a9ed-d934b79c9db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c939aafa-2d37-4750-a9ed-d934b79c9db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac904b9c-1e09-445c-bab3-7ab91764a831', 'volume_name': 'volume-ac904b9c-1e09-445c-bab3-7ab91764a831', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1a3c27-f870-4dd1-8d1d-398daab0b923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1a3c27-f870-4dd1-8d1d-398daab0b923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca5360a-a830-4abb-ac16-e4a1ba9da8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Volume ac904b9c-1e09-445c-bab3-7ab91764a831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac904b9c-1e09-445c-bab3-7ab91764a831', 'volume_size': 1} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-896578276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac904b9c-1e09-445c-bab3-7ab91764a831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c6bc9f96e84ee4b152f3ef04efc5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:23Z,use_quota=True,user_id='88eb2572198f49b5ae033afa29586566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39a05b44-b4b0-4958-8ce7-59a1a7075ff8),volume_type_id=39a05b44-b4b0-4958-8ce7-59a1a7075ff8)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Creating volume ac904b9c-1e09-445c-bab3-7ab91764a831 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:56:23 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:23 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831 1073741824 Sep 01 23:56:23 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:23 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831 1073741824" returned: 0 in 0.916s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:56:24 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831 Sep 01 23:56:24 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Flow 'volume_create_manager' (04d477a5-560a-4e5a-bdc3-653c2c28611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce94028-aa37-404b-b03b-de276e5c6a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce94028-aa37-404b-b03b-de276e5c6a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1955485948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfb86a2-dfe4-46d6-89e8-f32af4a19b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b03f2b9e13487baecb4ca3dea69ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:24Z,use_quota=True,user_id='812f4b8262b34eb8b83ca64d957853ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5a87b6-933e-4bc0-9624-d14d11bee2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5a87b6-933e-4bc0-9624-d14d11bee2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b519daf-2b2e-41ab-9c75-9f558734695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b519daf-2b2e-41ab-9c75-9f558734695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfb86a2-dfe4-46d6-89e8-f32af4a19b32', 'volume_name': 'volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b561b3f7-ba12-418a-8eda-5049cdc1d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b561b3f7-ba12-418a-8eda-5049cdc1d852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c2010e-dade-4439-b48b-2ef0c9dd7155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Volume ecfb86a2-dfe4-46d6-89e8-f32af4a19b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32', 'volume_size': 1} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:24 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831" returned: 0 in 0.639s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.265s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1955485948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfb86a2-dfe4-46d6-89e8-f32af4a19b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b03f2b9e13487baecb4ca3dea69ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:24Z,use_quota=True,user_id='812f4b8262b34eb8b83ca64d957853ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Creating volume ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:56:24 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca5360a-a830-4abb-ac16-e4a1ba9da8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac904b9c-1e09-445c-bab3-7ab91764a831', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:24 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 1073741824 Sep 01 23:56:24 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae415cd9-0e66-4459-8c6a-aa6050cb5c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Volume volume-ac904b9c-1e09-445c-bab3-7ab91764a831 (ac904b9c-1e09-445c-bab3-7ab91764a831): created successfully Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae415cd9-0e66-4459-8c6a-aa6050cb5c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Flow 'volume_create_manager' (263eef81-9257-4f1e-ae59-1d1e4202484d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2f1ae9b9-1d1f-4764-a2ba-2421592c9359 tempest-VolumeTypesAccessTest-1399092985 None] Created volume successfully. Sep 01 23:56:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Acquiring lock "cinder-quobyte-19b019d1-494e-4a3b-8fa5-2f171a58629f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Lock "cinder-quobyte-19b019d1-494e-4a3b-8fa5-2f171a58629f" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c47811-2058-481d-9c05-81dc280de450]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:56:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:25 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f Sep 01 23:56:25 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:25 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 1073741824" returned: 0 in 0.837s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:25 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 Sep 01 23:56:25 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:25 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f" returned: 0 in 0.688s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Acquiring lock "cinder-ac904b9c-1e09-445c-bab3-7ab91764a831-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Lock "cinder-ac904b9c-1e09-445c-bab3-7ab91764a831-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:26 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f Sep 01 23:56:26 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Acquiring lock "cinder-quobyte-ac904b9c-1e09-445c-bab3-7ab91764a831" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Lock "cinder-quobyte-ac904b9c-1e09-445c-bab3-7ab91764a831" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cd9685-f0ae-48b3-bc68-cdf1e99b4d14]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:26 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32" returned: 0 in 0.627s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c2010e-dade-4439-b48b-2ef0c9dd7155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522bcf19-be6a-4b59-a7e3-d62565b8a8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Volume volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 (ecfb86a2-dfe4-46d6-89e8-f32af4a19b32): created successfully Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522bcf19-be6a-4b59-a7e3-d62565b8a8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Flow 'volume_create_manager' (04d477a5-560a-4e5a-bdc3-653c2c28611e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:26 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831 Sep 01 23:56:26 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5dd6726e-d37e-4d37-be13-8ea08a350ea3 tempest-ServerRescueNegativeTestJSON-2049964194 None] Created volume successfully. Sep 01 23:56:26 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b019d1-494e-4a3b-8fa5-2f171a58629f" returned: 0 in 0.583s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Lock "cinder-quobyte-19b019d1-494e-4a3b-8fa5-2f171a58629f" released by "delete_volume" :: held 1.332s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Acquiring lock "cinder-quobyte-2f45a653-5b3d-4410-9600-92c02cd742bc" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Lock "cinder-quobyte-2f45a653-5b3d-4410-9600-92c02cd742bc" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c526f7-3023-46c2-b729-a42eea40d527]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:26 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831" returned: 0 in 0.626s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:26 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831 Sep 01 23:56:26 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:26 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc Sep 01 23:56:26 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:27 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ac904b9c-1e09-445c-bab3-7ab91764a831" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Lock "cinder-quobyte-ac904b9c-1e09-445c-bab3-7ab91764a831" released by "delete_volume" :: held 0.987s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:27 devstack cinder-volume[86591]: WARNING cinder.quota [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-924059513 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-924059513, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:56:27 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:27 devstack cinder-volume[86591]: WARNING cinder.quota [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-924059513 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-924059513, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc" returned: 0 in 0.479s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:27 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc Sep 01 23:56:27 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Created reservations ['5102ef21-f3fa-44f7-9448-68fe630440ec', 'a3ec9d9e-40bf-4918-b3c7-afec520e7f69', 'e0009e13-9602-419b-ab9b-8c304851ab34', '23ef7a44-92e1-4915-bba2-ce245aed51c7'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:27 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:56:27 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:27 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2f45a653-5b3d-4410-9600-92c02cd742bc" returned: 0 in 0.414s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Lock "cinder-quobyte-2f45a653-5b3d-4410-9600-92c02cd742bc" released by "delete_volume" :: held 0.973s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:27 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Created reservations ['7d7101a4-04ad-4e73-b0b6-ee1db8709f90'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:27 devstack cinder-volume[86591]: WARNING cinder.quota [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-696667031 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-696667031, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:56:27 devstack cinder-volume[86591]: WARNING cinder.quota [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-696667031 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-696667031, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Created reservations ['276a4598-c85d-4785-b0e2-1a4d8b25d434', '12837cb7-7bd4-4019-89fc-8ea2018a5f7c', '36961cc9-23af-487f-9052-a04e32c71d5d', '3878f692-a7b4-4557-ad5b-fea1810b6d3e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:28 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.746s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:56:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Deleted volume successfully. Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6934ea-5963-4384-b605-448a516be3e0 tempest-VolumeTypesAccessTest-1399092985 None] Lock "cinder-ac904b9c-1e09-445c-bab3-7ab91764a831-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Created reservations ['d163d530-6268-4b18-b183-8f1a5a25fa55', '792c2d79-fe3e-4baf-a053-639f71660679', '29fff848-dfb0-4bc0-86bc-f36d166ff2ae', '99129a5e-90f1-49bd-ac9d-6251dcf91c87'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:28 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:56:28 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:29 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:29 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:56:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cb509213-0884-4bf0-968c-189c1ded7cc4 tempest-GroupsTest-2087157809 None] Delete group completed successfully. Sep 01 23:56:38 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=48,cinder:UPDATE=73,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:56:38 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=68,cinder:UPDATE=50,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:56:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Acquiring lock "cinder-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "cinder-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Acquiring lock "cinder-quobyte-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "cinder-quobyte-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32" acquired by "delete_volume" :: waited 0.049s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a56eb1-1453-41ba-99cb-43b62fe0adb8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:56:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:39 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 Sep 01 23:56:39 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:40 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32" returned: 0 in 0.464s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:40 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32 Sep 01 23:56:40 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:40 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "cinder-quobyte-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32" released by "delete_volume" :: held 0.910s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Created reservations ['f42a337e-f279-4962-9e20-0ca3e156fbe2', '09f3f558-4139-4a28-9b38-8964b427c950', '33c9a206-c2b1-4afd-b703-e9d187aa0fd9', '68a9a0f4-caaf-4e92-ad6c-7e7673a34142'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:40 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:56:40 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Flow 'volume_create_manager' (9ac083a7-0422-4480-80fd-ee792914d1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eab9a50-4d31-4adf-a328-fdc3107fdbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eab9a50-4d31-4adf-a328-fdc3107fdbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1664884677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2e24d3-035c-459c-9da3-532976dd7a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57637967534c9891cfe8490f6d25b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:41Z,use_quota=True,user_id='5b86e0c4491c486e95a2a4eb9099d2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e612475b-cb23-44c4-a8e9-c90e2ec8af40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e612475b-cb23-44c4-a8e9-c90e2ec8af40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab7ba3b-8da4-4b67-939e-59716ad39855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:41 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab7ba3b-8da4-4b67-939e-59716ad39855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d2e24d3-035c-459c-9da3-532976dd7a4d', 'volume_name': 'volume-5d2e24d3-035c-459c-9da3-532976dd7a4d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c656fd-f5db-48bb-8dfd-018f61826d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c656fd-f5db-48bb-8dfd-018f61826d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db937ae3-45e1-4286-ad22-9b1b60906bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Volume 5d2e24d3-035c-459c-9da3-532976dd7a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d2e24d3-035c-459c-9da3-532976dd7a4d', 'volume_size': 1} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1664884677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2e24d3-035c-459c-9da3-532976dd7a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57637967534c9891cfe8490f6d25b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:41Z,use_quota=True,user_id='5b86e0c4491c486e95a2a4eb9099d2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Creating volume 5d2e24d3-035c-459c-9da3-532976dd7a4d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:56:41 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.437s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:56:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Deleted volume successfully. Sep 01 23:56:41 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d 1073741824 Sep 01 23:56:41 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-694ca67e-b0ed-4bd4-ab1a-907becd45a81 tempest-ServerRescueNegativeTestJSON-2049964194 None] Lock "cinder-ecfb86a2-dfe4-46d6-89e8-f32af4a19b32-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:42 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d 1073741824" returned: 0 in 1.008s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:42 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d Sep 01 23:56:42 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:42 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d" returned: 0 in 0.479s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:56:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db937ae3-45e1-4286-ad22-9b1b60906bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2e24d3-035c-459c-9da3-532976dd7a4d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4a6d31-bf62-44cd-a958-eae629297d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Volume volume-5d2e24d3-035c-459c-9da3-532976dd7a4d (5d2e24d3-035c-459c-9da3-532976dd7a4d): created successfully Sep 01 23:56:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4a6d31-bf62-44cd-a958-eae629297d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Flow 'volume_create_manager' (9ac083a7-0422-4480-80fd-ee792914d1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e51363a3-4c6b-44cd-bf9c-0b2e879d10fb tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Created volume successfully. Sep 01 23:56:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Acquiring lock "cinder-5d2e24d3-035c-459c-9da3-532976dd7a4d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "cinder-5d2e24d3-035c-459c-9da3-532976dd7a4d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Acquiring lock "cinder-quobyte-5d2e24d3-035c-459c-9da3-532976dd7a4d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "cinder-quobyte-5d2e24d3-035c-459c-9da3-532976dd7a4d" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d83a8fc-2b01-4fd2-ae41-6ef5c0ace301]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:56:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:45 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d Sep 01 23:56:45 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:45 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d" returned: 0 in 0.771s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:45 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d Sep 01 23:56:45 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:46 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5d2e24d3-035c-459c-9da3-532976dd7a4d" returned: 0 in 0.373s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "cinder-quobyte-5d2e24d3-035c-459c-9da3-532976dd7a4d" released by "delete_volume" :: held 1.202s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Created reservations ['bee94afc-b10e-4ad5-8c2d-b1cc8f1a44b2', '803933cd-df95-42ff-8e59-e8e6bc754086', 'd464a921-2837-428c-8f6a-6d4cc78b8ab2', 'd93a766e-14fc-4f78-bdb7-6374c72857b9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:46 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:56:46 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:46 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.367s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:56:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Deleted volume successfully. Sep 01 23:56:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5bb018c5-bb00-4f42-9d8d-d4050fd7d8dc tempest-VolumeQuotasNegativeTestJSON-2019922095 None] Lock "cinder-5d2e24d3-035c-459c-9da3-532976dd7a4d-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-d326bde9-3e54-410c-8888-4879f2257a82 tempest-ServerActionsTestOtherA-1621420664 None] Terminate volume connection completed successfully. Sep 01 23:56:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-d326bde9-3e54-410c-8888-4879f2257a82 tempest-ServerActionsTestOtherA-1621420664 None] Deleting attachment 48f2d535-8c61-4af8-9002-149fd7c7df11. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 23:56:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "cinder-04a5e773-6a8f-4e70-862c-f840c5bd90a0-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Lock "cinder-04a5e773-6a8f-4e70-862c-f840c5bd90a0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "cinder-quobyte-04a5e773-6a8f-4e70-862c-f840c5bd90a0" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Lock "cinder-quobyte-04a5e773-6a8f-4e70-862c-f840c5bd90a0" acquired by "delete_volume" :: waited 0.050s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7da91a-83f3-4d2e-a007-d7c1da3ab875]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:56:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:55 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 Sep 01 23:56:55 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:56 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0" returned: 0 in 0.662s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:56 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0 Sep 01 23:56:56 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:56 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a5e773-6a8f-4e70-862c-f840c5bd90a0" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Lock "cinder-quobyte-04a5e773-6a8f-4e70-862c-f840c5bd90a0" released by "delete_volume" :: held 1.045s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG cinder.quota [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Created reservations ['43ad6f09-d243-4a91-b56b-179fb95ff26b', 'fca88fc9-0b64-4af9-94b2-920d5c7840ef', 'efee29d2-cfc3-4746-b529-8bddce2781bb', '92d903cf-a82a-48f1-b9ef-c497f7bb3a26'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:56 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:56:56 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:57 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.manager [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:56:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Deleted volume successfully. Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-3f1ac9a4-f028-458d-9455-c1a14bc4bb5d req-82ad105d-e918-4861-ab40-144e028abe33 tempest-ServerActionsTestOtherA-1621420664 None] Lock "cinder-04a5e773-6a8f-4e70-862c-f840c5bd90a0-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "cinder-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Lock "cinder-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "cinder-quobyte-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Lock "cinder-quobyte-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef5a14e-df1e-4710-98f4-20a4c757a1f3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:57 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 Sep 01 23:56:57 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Flow 'volume_create_manager' (7c3bcce8-c39d-47ea-8a76-ff353e50d675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8e7888-2d59-478d-b101-2568e0e57210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:57 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0" returned: 0 in 0.609s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8e7888-2d59-478d-b101-2568e0e57210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-5781531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9981960-ce8f-4a87-8df9-10037a98cf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b837bcdd5a34b279891db7502ccc933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:58Z,use_quota=True,user_id='ebf22cb4a7f5490182d08e521ec8fc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:57 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0 Sep 01 23:56:57 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127d91d2-16b1-4b4c-b386-82d6b705d569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127d91d2-16b1-4b4c-b386-82d6b705d569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b354519f-7a16-4f1f-bd55-69e0d2219895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b354519f-7a16-4f1f-bd55-69e0d2219895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9981960-ce8f-4a87-8df9-10037a98cf99', 'volume_name': 'volume-e9981960-ce8f-4a87-8df9-10037a98cf99', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace7efc4-43ba-4e1a-ada2-66185f9c771b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace7efc4-43ba-4e1a-ada2-66185f9c771b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6fad05-e1b2-4fe1-8ca7-aaa19a31e8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:57 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Volume e9981960-ce8f-4a87-8df9-10037a98cf99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9981960-ce8f-4a87-8df9-10037a98cf99', 'volume_size': 1} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-5781531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9981960-ce8f-4a87-8df9-10037a98cf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b837bcdd5a34b279891db7502ccc933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:56:58Z,use_quota=True,user_id='ebf22cb4a7f5490182d08e521ec8fc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Creating volume e9981960-ce8f-4a87-8df9-10037a98cf99 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:56:58 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:58 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99 1073741824 Sep 01 23:56:58 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:58 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Lock "cinder-quobyte-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0" released by "delete_volume" :: held 1.032s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Created reservations ['3c43e9f8-eb84-41ed-9a31-0b70e23e2f7d', '66ba9084-d21f-48fa-a71f-0f1f8c8b25e0', '3066f186-6ff3-42fc-929c-f57c6cf0522f', 'f7a33d9f-1a93-4020-bd2a-c177f0fd2725'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:58 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:56:58 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:58 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99 1073741824" returned: 0 in 0.617s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:56:58 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99 Sep 01 23:56:58 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:56:58 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:56:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Deleted volume successfully. Sep 01 23:56:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fa4a8c94-6858-49af-b9d7-5a18de1cad1e tempest-ServerActionsTestOtherA-1621420664 None] Lock "cinder-f1617e40-6f6c-4c62-99e8-28f4eb71e1e0-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:56:59 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Sep 01 23:56:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99" returned: 0 in 0.321s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:56:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:56:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:56:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6fad05-e1b2-4fe1-8ca7-aaa19a31e8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9981960-ce8f-4a87-8df9-10037a98cf99', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c186a323-a55b-44e4-b35f-4d6b9fcfc749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:56:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Volume volume-e9981960-ce8f-4a87-8df9-10037a98cf99 (e9981960-ce8f-4a87-8df9-10037a98cf99): created successfully Sep 01 23:56:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c186a323-a55b-44e4-b35f-4d6b9fcfc749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:56:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Flow 'volume_create_manager' (7c3bcce8-c39d-47ea-8a76-ff353e50d675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:56:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6dc58a47-ffe4-4fd0-9067-3f006213fb7c tempest-VolumesServicesTestJSON-853491089 None] Created volume successfully. Sep 01 23:57:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Acquiring lock "cinder-e9981960-ce8f-4a87-8df9-10037a98cf99-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Lock "cinder-e9981960-ce8f-4a87-8df9-10037a98cf99-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Acquiring lock "cinder-quobyte-e9981960-ce8f-4a87-8df9-10037a98cf99" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Lock "cinder-quobyte-e9981960-ce8f-4a87-8df9-10037a98cf99" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1593100a-fa4a-4f19-aa30-ce0e08504c27]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:57:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:00 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99 Sep 01 23:57:00 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:00 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99" returned: 0 in 0.578s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:00 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99 Sep 01 23:57:00 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:01 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9981960-ce8f-4a87-8df9-10037a98cf99" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Lock "cinder-quobyte-e9981960-ce8f-4a87-8df9-10037a98cf99" released by "delete_volume" :: held 0.954s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Created reservations ['fcd21381-7b1a-4424-b613-a1b21f4c090b', '57eea0fa-6622-402d-b1ac-c4da81b8cded', '25840f4b-9f1a-4aa6-a9cc-1f2e0491aa7d', 'ba54c75c-c865-49a3-a11b-6557e84a9cde'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:01 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:57:01 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:01 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:57:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Deleted volume successfully. Sep 01 23:57:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-579dff38-e3c5-4d00-a9c3-e25281a548cd tempest-VolumesServicesTestJSON-853491089 None] Lock "cinder-e9981960-ce8f-4a87-8df9-10037a98cf99-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:06 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:57:06 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:06 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.344s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:57:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:57:11 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=31,cinder:INSERT=11,cinder:UPDATE=48,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:57:11 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=44,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=6 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Flow 'volume_create_manager' (ecb70c6b-1085-4247-8896-cf060d547e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16b22c5-dde3-4f37-b0a2-bea611c3645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16b22c5-dde3-4f37-b0a2-bea611c3645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-758634134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e07ee9c-4262-492c-aebc-022a85b844f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc85036f2fe24f8e84cb69f9441b9ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:57:16Z,use_quota=True,user_id='b2022b2de39847b4bd3c412d47b9af29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006289ab-1ad7-4162-8e2d-3f67ae67df76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006289ab-1ad7-4162-8e2d-3f67ae67df76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0beb12b-2911-4ed1-aeb5-3df96c98955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0beb12b-2911-4ed1-aeb5-3df96c98955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e07ee9c-4262-492c-aebc-022a85b844f6', 'volume_name': 'volume-8e07ee9c-4262-492c-aebc-022a85b844f6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a512b932-a29d-4969-a753-559462275784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a512b932-a29d-4969-a753-559462275784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f862c628-54d8-46b2-ac2b-c72e6c42dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:15 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Volume 8e07ee9c-4262-492c-aebc-022a85b844f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e07ee9c-4262-492c-aebc-022a85b844f6', 'volume_size': 1} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-758634134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e07ee9c-4262-492c-aebc-022a85b844f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc85036f2fe24f8e84cb69f9441b9ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:57:16Z,use_quota=True,user_id='b2022b2de39847b4bd3c412d47b9af29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Creating volume 8e07ee9c-4262-492c-aebc-022a85b844f6 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:57:15 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:57:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:15 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 1073741824 Sep 01 23:57:15 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:16 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 1073741824" returned: 0 in 0.673s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:16 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 Sep 01 23:57:16 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:16 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6" returned: 0 in 0.302s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:57:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f862c628-54d8-46b2-ac2b-c72e6c42dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e07ee9c-4262-492c-aebc-022a85b844f6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ad3671-fb5d-4d71-8da8-8e3c4f626692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Volume volume-8e07ee9c-4262-492c-aebc-022a85b844f6 (8e07ee9c-4262-492c-aebc-022a85b844f6): created successfully Sep 01 23:57:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ad3671-fb5d-4d71-8da8-8e3c4f626692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Flow 'volume_create_manager' (ecb70c6b-1085-4247-8896-cf060d547e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:57:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-935fa5ef-351c-4926-ab3c-10632027d525 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Created volume successfully. Sep 01 23:57:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Creating offline snapshot fd74ebab-ba5c-490f-9446-de57fc33652b of volume 8e07ee9c-4262-492c-aebc-022a85b844f6 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:57:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1945f500-a919-4d76-887b-884c12cd9703]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:57:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:18 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 Sep 01 23:57:18 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:18 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6" returned: 0 in 0.696s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:18 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b 1G Sep 01 23:57:18 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:19 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b 1G" returned: 0 in 0.623s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e07ee9c-4262-492c-aebc-022a85b844f6 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:19 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e07ee9c-4262-492c-aebc-022a85b844f6 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b Sep 01 23:57:19 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:19 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e07ee9c-4262-492c-aebc-022a85b844f6 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:19 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b is being set with open permissions: ugo+rw Sep 01 23:57:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:19 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b Sep 01 23:57:19 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:20 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b" returned: 0 in 0.298s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:20 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.info Sep 01 23:57:20 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:20 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.info" returned: 0 in 0.308s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:20 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.info is being set with open permissions: ugo+rw Sep 01 23:57:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:20 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.info Sep 01 23:57:20 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:20 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.info" returned: 0 in 0.252s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-75958d90-f9c2-46fb-ad69-b3dfe7edfd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Create snapshot completed successfully Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Acquiring lock "cinder-fd74ebab-ba5c-490f-9446-de57fc33652b-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-fd74ebab-ba5c-490f-9446-de57fc33652b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Acquiring lock "cinder-quobyte-8e07ee9c-4262-492c-aebc-022a85b844f6" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-quobyte-8e07ee9c-4262-492c-aebc-022a85b844f6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Acquiring lock "cinder-quobyte-fd74ebab-ba5c-490f-9446-de57fc33652b" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-quobyte-fd74ebab-ba5c-490f-9446-de57fc33652b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Deleting offline snapshot fd74ebab-ba5c-490f-9446-de57fc33652b of volume 8e07ee9c-4262-492c-aebc-022a85b844f6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] snapshot_file for this snap is: volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a2f851-ab7a-4b7b-accd-6387d21b7766]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:57:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:21 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b Sep 01 23:57:21 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:22 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b" returned: 0 in 0.519s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e07ee9c-4262-492c-aebc-022a85b844f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:57:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[02288426-d820-411c-a49c-3c3594728ea9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:57:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:22 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 Sep 01 23:57:22 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:22 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6" returned: 0 in 0.483s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:22 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b Sep 01 23:57:22 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:23 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:23 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b Sep 01 23:57:23 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:23 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6.fd74ebab-ba5c-490f-9446-de57fc33652b" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-quobyte-fd74ebab-ba5c-490f-9446-de57fc33652b" released by "_delete_snapshot" :: held 1.949s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-quobyte-8e07ee9c-4262-492c-aebc-022a85b844f6" released by "delete_snapshot" :: held 1.974s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:23 devstack cinder-volume[86591]: WARNING cinder.quota [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 23:57:23 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Created reservations ['692c502a-7855-4ace-a44c-bfe631d64208', 'e498628e-05e1-4602-be2b-6708c32cf6db', '66822a49-4790-4854-a0f7-58ca20bdfd63', 'b7b4dd77-3d5f-4152-8990-9c03b06973ee'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:57:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Delete snapshot completed successfully. Sep 01 23:57:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-848da99b-5155-4c57-94f2-35e4e2fccd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-fd74ebab-ba5c-490f-9446-de57fc33652b-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Acquiring lock "cinder-8e07ee9c-4262-492c-aebc-022a85b844f6-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-8e07ee9c-4262-492c-aebc-022a85b844f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Acquiring lock "cinder-quobyte-8e07ee9c-4262-492c-aebc-022a85b844f6" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-quobyte-8e07ee9c-4262-492c-aebc-022a85b844f6" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d794216-64d8-419b-9822-7d450b48b5d2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:57:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:25 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 Sep 01 23:57:25 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:26 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6" returned: 0 in 0.908s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:26 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6 Sep 01 23:57:26 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:26 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e07ee9c-4262-492c-aebc-022a85b844f6" returned: 0 in 0.647s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-quobyte-8e07ee9c-4262-492c-aebc-022a85b844f6" released by "delete_volume" :: held 1.780s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Created reservations ['8f9a2f06-99ff-4c5a-b173-06c45c44f593', '9a7f64a8-7e2c-47d1-9ed4-ed5c080f08d8', 'fda7322a-8c6c-4516-9711-f8075a3e5f3e', 'd30a5e88-0e26-45cc-bf7d-830a4b7d4719'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:27 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:57:27 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:27 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.464s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:57:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Deleted volume successfully. Sep 01 23:57:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30eb2346-d674-4d70-af9e-70fd10f457a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-939104531 None] Lock "cinder-8e07ee9c-4262-492c-aebc-022a85b844f6-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:37 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=17,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:57:37 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=13,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (d13cdd30-1767-4326-a2c8-7c1a224f844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21d9411-8c8b-4730-b0c0-6a7800dd4294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21d9411-8c8b-4730-b0c0-6a7800dd4294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-310610779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e02ae63-137e-4329-b751-5a2d4d635bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:57:42Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cd2fa7-83da-43b9-94dd-c26045925f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cd2fa7-83da-43b9-94dd-c26045925f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138e96d6-9aeb-4398-ab9a-e8123d5b3b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138e96d6-9aeb-4398-ab9a-e8123d5b3b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e02ae63-137e-4329-b751-5a2d4d635bd3', 'volume_name': 'volume-6e02ae63-137e-4329-b751-5a2d4d635bd3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bda68aa-39b1-4c8b-825c-5cd760fe3831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bda68aa-39b1-4c8b-825c-5cd760fe3831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f92817a-b898-463d-a9ed-80fdba539fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Volume 6e02ae63-137e-4329-b751-5a2d4d635bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e02ae63-137e-4329-b751-5a2d4d635bd3', 'volume_size': 1} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-310610779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e02ae63-137e-4329-b751-5a2d4d635bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:57:42Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Creating volume 6e02ae63-137e-4329-b751-5a2d4d635bd3 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:57:42 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:42 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 1073741824 Sep 01 23:57:42 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:42 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 1073741824" returned: 0 in 0.612s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:42 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 Sep 01 23:57:42 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:43 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3" returned: 0 in 0.544s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:57:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f92817a-b898-463d-a9ed-80fdba539fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e02ae63-137e-4329-b751-5a2d4d635bd3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a17ed6-a9b4-472d-9461-cd441abc72f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:43 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Volume volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 (6e02ae63-137e-4329-b751-5a2d4d635bd3): created successfully Sep 01 23:57:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a17ed6-a9b4-472d-9461-cd441abc72f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (d13cdd30-1767-4326-a2c8-7c1a224f844a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:57:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9e85ffd4-a51b-4917-baac-d7d72b1e90a3 tempest-VolumesActionsTest-1265680344 None] Created volume successfully. Sep 01 23:57:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d998b7e5-03ce-43d0-9e2a-30d4d2c670ad tempest-VolumesActionsTest-1265680344 None] Acquiring lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3" by "attach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d998b7e5-03ce-43d0-9e2a-30d4d2c670ad tempest-VolumesActionsTest-1265680344 None] Lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3" acquired by "attach_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d998b7e5-03ce-43d0-9e2a-30d4d2c670ad tempest-VolumesActionsTest-1265680344 None] Attaching volume 6e02ae63-137e-4329-b751-5a2d4d635bd3 to instance 29c7e762-a9ab-4d1c-a1e4-b9f46ab4217f at mountpoint /dev/vdb on host None. Sep 01 23:57:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d998b7e5-03ce-43d0-9e2a-30d4d2c670ad tempest-VolumesActionsTest-1265680344 None] Attach volume completed successfully. Sep 01 23:57:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d998b7e5-03ce-43d0-9e2a-30d4d2c670ad tempest-VolumesActionsTest-1265680344 None] Lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3" released by "attach_volume" :: held 0.159s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b5747826-43bc-4e45-974d-37746ed51c36 tempest-VolumesActionsTest-936082220 None] Terminate volume connection completed successfully. Sep 01 23:57:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b5747826-43bc-4e45-974d-37746ed51c36 tempest-VolumesActionsTest-936082220 None] Acquiring lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3-detach_volume" by "detach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b5747826-43bc-4e45-974d-37746ed51c36 tempest-VolumesActionsTest-936082220 None] Lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b5747826-43bc-4e45-974d-37746ed51c36 tempest-VolumesActionsTest-936082220 None] Detaching volume 6e02ae63-137e-4329-b751-5a2d4d635bd3 from instance 29c7e762-a9ab-4d1c-a1e4-b9f46ab4217f. Sep 01 23:57:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b5747826-43bc-4e45-974d-37746ed51c36 tempest-VolumesActionsTest-936082220 None] Detach volume completed successfully. Sep 01 23:57:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b5747826-43bc-4e45-974d-37746ed51c36 tempest-VolumesActionsTest-936082220 None] Lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3-detach_volume" released by "detach_volume" :: held 0.206s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8c907f80-d86c-459d-afff-ef5380637675 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3-detach_volume" by "detach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8c907f80-d86c-459d-afff-ef5380637675 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8c907f80-d86c-459d-afff-ef5380637675 tempest-VolumesActionsTest-1265680344 None] Volume detach called, but volume not attached. Sep 01 23:57:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8c907f80-d86c-459d-afff-ef5380637675 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "cinder-quobyte-6e02ae63-137e-4329-b751-5a2d4d635bd3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-quobyte-6e02ae63-137e-4329-b751-5a2d4d635bd3" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b45a2ea-55ab-4ee9-a4b8-f836a6107ac3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:57:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:47 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 Sep 01 23:57:47 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:47 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3" returned: 0 in 0.796s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:47 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3 Sep 01 23:57:47 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:48 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6e02ae63-137e-4329-b751-5a2d4d635bd3" returned: 0 in 0.712s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-quobyte-6e02ae63-137e-4329-b751-5a2d4d635bd3" released by "delete_volume" :: held 1.609s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:48 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Created reservations ['3aa175bf-7714-424c-b959-ac762793000a', '5bc36182-b9d5-4858-992f-0ebc44e57cee', 'e3bb7e05-3f34-4729-801d-24495c25fcca', '40d94871-3e76-4066-b9f6-4f981ad3ba54'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:57:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:57:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:57:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:49 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:57:49 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:49 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.828s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:49 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:57:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Deleted volume successfully. Sep 01 23:57:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6485b7e4-a137-4ed5-92e7-4f4109e0b879 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-6e02ae63-137e-4329-b751-5a2d4d635bd3-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (0ebdb32e-e25b-47d4-a44e-66ea2b6945af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0d87ab-6f12-4e55-8fa0-f0527e6fdbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0d87ab-6f12-4e55-8fa0-f0527e6fdbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-244790720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f8b0b4-a1ed-424e-ac46-0f722535699d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:57:55Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629412fc-38c0-465d-b2a6-08d0a913c2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629412fc-38c0-465d-b2a6-08d0a913c2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac9c05b-98aa-4ec3-a561-5641ecb430dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac9c05b-98aa-4ec3-a561-5641ecb430dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f8b0b4-a1ed-424e-ac46-0f722535699d', 'volume_name': 'volume-49f8b0b4-a1ed-424e-ac46-0f722535699d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c89758c-9891-423f-953b-0f3cbd6a78ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c89758c-9891-423f-953b-0f3cbd6a78ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516352a1-b93e-40c4-9839-efd7beec0241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Volume 49f8b0b4-a1ed-424e-ac46-0f722535699d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f8b0b4-a1ed-424e-ac46-0f722535699d', 'volume_size': 1} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-244790720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f8b0b4-a1ed-424e-ac46-0f722535699d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:57:55Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Creating volume 49f8b0b4-a1ed-424e-ac46-0f722535699d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:57:55 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:55 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d 1073741824 Sep 01 23:57:55 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:55 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d 1073741824" returned: 0 in 0.519s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:55 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d Sep 01 23:57:55 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:56 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516352a1-b93e-40c4-9839-efd7beec0241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f8b0b4-a1ed-424e-ac46-0f722535699d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6373336e-299c-48cf-880f-2d8dc8686c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Volume volume-49f8b0b4-a1ed-424e-ac46-0f722535699d (49f8b0b4-a1ed-424e-ac46-0f722535699d): created successfully Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6373336e-299c-48cf-880f-2d8dc8686c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (0ebdb32e-e25b-47d4-a44e-66ea2b6945af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:57:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2c509e65-9593-4d50-bf37-a636b95f11f7 tempest-VolumesActionsTest-1265680344 None] Created volume successfully. Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Flow 'volume_create_manager' (29076308-b824-467f-9efd-07f5ad1cf09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5decf283-1e84-46eb-8e2c-b984dd5b7380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5decf283-1e84-46eb-8e2c-b984dd5b7380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-65123650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b3eeef9c02453ab63f7abefb287560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:57:56Z,use_quota=True,user_id='1ec1cef63f3e4862a20f71de35dd2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7067a812-d5e9-4104-b4f7-b97c5b5be970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7067a812-d5e9-4104-b4f7-b97c5b5be970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be2bea2-a4a2-491b-996f-a1606a3c3b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be2bea2-a4a2-491b-996f-a1606a3c3b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea', 'volume_name': 'volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50c7b6d-41a3-47ec-8b89-4a29e517e281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50c7b6d-41a3-47ec-8b89-4a29e517e281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5413a7-0efa-4a5c-83f2-ec953e08f79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Volume aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea', 'volume_size': 1} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-65123650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b3eeef9c02453ab63f7abefb287560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:57:56Z,use_quota=True,user_id='1ec1cef63f3e4862a20f71de35dd2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Creating volume aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:57:56 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:57:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:56 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea 1073741824 Sep 01 23:57:56 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:57 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea 1073741824" returned: 0 in 0.691s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:57 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea Sep 01 23:57:57 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Acquiring lock "cinder-49f8b0b4-a1ed-424e-ac46-0f722535699d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Lock "cinder-49f8b0b4-a1ed-424e-ac46-0f722535699d-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Acquiring lock "cinder-quobyte-49f8b0b4-a1ed-424e-ac46-0f722535699d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:57:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Lock "cinder-quobyte-49f8b0b4-a1ed-424e-ac46-0f722535699d" acquired by "delete_volume" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cd3795-98db-4220-a5f9-2406acb48d49]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:58 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea" returned: 0 in 0.789s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5413a7-0efa-4a5c-83f2-ec953e08f79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f248fe4d-8d4b-4733-8872-6c733d536b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:57:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Volume volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea (aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea): created successfully Sep 01 23:57:58 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d Sep 01 23:57:58 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f248fe4d-8d4b-4733-8872-6c733d536b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Flow 'volume_create_manager' (29076308-b824-467f-9efd-07f5ad1cf09c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:57:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-64b4e07f-15c7-468b-b202-06f1cd7f7d21 tempest-ServersNegativeTestJSON-415133903 None] Created volume successfully. Sep 01 23:57:58 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d" returned: 0 in 0.800s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:58 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d Sep 01 23:57:58 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:59 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-49f8b0b4-a1ed-424e-ac46-0f722535699d" returned: 0 in 0.440s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Lock "cinder-quobyte-49f8b0b4-a1ed-424e-ac46-0f722535699d" released by "delete_volume" :: held 1.343s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Created reservations ['27c53c40-4818-4970-85ae-01ee7dde75ba', 'ad8fe2ff-85c0-4b5a-80e8-1e8d8a23e0d5', '5c299ea1-fcd0-44c8-b8e8-0ec76cebf0c4', '3710945c-ec51-4a8d-b599-939d9ec6b856'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:57:59 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:57:59 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:57:59 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.360s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:57:59 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:57:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Deleted volume successfully. Sep 01 23:58:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b010b96e-8695-4f9b-ad0e-a3348e32871a tempest-VolumesActionsTest-936082220 None] Lock "cinder-49f8b0b4-a1ed-424e-ac46-0f722535699d-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:00 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (71866a94-2a42-474e-a61c-0af595755b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1969929-c16e-4592-b09b-c17e66cb336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1969929-c16e-4592-b09b-c17e66cb336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1709743372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22424c6b-b5b3-4603-a053-b6d9cf7c7ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:01Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9ef7bd-b462-44a9-a024-a7ba8d7210c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9ef7bd-b462-44a9-a024-a7ba8d7210c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb0f898-714d-4c69-bd9f-5b68ec0f6c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb0f898-714d-4c69-bd9f-5b68ec0f6c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22424c6b-b5b3-4603-a053-b6d9cf7c7ea5', 'volume_name': 'volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bbc79f-09ec-42bf-867a-980acfa4de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bbc79f-09ec-42bf-867a-980acfa4de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1001c3a-8a06-40cf-96d0-54ac8ab2e68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Volume 22424c6b-b5b3-4603-a053-b6d9cf7c7ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5', 'volume_size': 1} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1709743372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22424c6b-b5b3-4603-a053-b6d9cf7c7ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:01Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Creating volume 22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:01 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:01 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 1073741824 Sep 01 23:58:01 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Flow 'volume_create_manager' (2d398a89-7f7d-40bb-83f1-9228cde6bbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fcacc6-9c07-42c5-b2a3-0db7a1c7283d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fcacc6-9c07-42c5-b2a3-0db7a1c7283d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1406540077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992d0d44-c493-475f-988f-5bd8105b9961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b3eeef9c02453ab63f7abefb287560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:01Z,use_quota=True,user_id='1ec1cef63f3e4862a20f71de35dd2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b336899e-4323-453c-b342-9ca4c90534b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b336899e-4323-453c-b342-9ca4c90534b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a248d82-c06d-4f0e-ac09-80d8b3304949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a248d82-c06d-4f0e-ac09-80d8b3304949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '992d0d44-c493-475f-988f-5bd8105b9961', 'volume_name': 'volume-992d0d44-c493-475f-988f-5bd8105b9961', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9ff150-827d-443c-b56d-0f765dc85701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9ff150-827d-443c-b56d-0f765dc85701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8be9576-0092-44ac-b92f-619b4ccf8d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Volume 992d0d44-c493-475f-988f-5bd8105b9961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-992d0d44-c493-475f-988f-5bd8105b9961', 'volume_size': 1} Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:01 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 1073741824" returned: 0 in 0.776s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:02 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 Sep 01 23:58:02 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:02 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1406540077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992d0d44-c493-475f-988f-5bd8105b9961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b3eeef9c02453ab63f7abefb287560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:01Z,use_quota=True,user_id='1ec1cef63f3e4862a20f71de35dd2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Creating volume 992d0d44-c493-475f-988f-5bd8105b9961 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:02 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:02 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961 1073741824 Sep 01 23:58:02 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1001c3a-8a06-40cf-96d0-54ac8ab2e68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97c964a-e815-41da-8826-b21b9ca8d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:02 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Volume volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 (22424c6b-b5b3-4603-a053-b6d9cf7c7ea5): created successfully Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97c964a-e815-41da-8826-b21b9ca8d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (71866a94-2a42-474e-a61c-0af595755b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-132d8608-547c-40aa-b4d5-91c74c4ac167 tempest-VolumesActionsTest-1265680344 None] Created volume successfully. Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Flow 'volume_create_manager' (0ac0e504-87b5-4b42-bf99-25860730f175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0a7a03-8e5c-42dc-ab0e-348caf08e47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0a7a03-8e5c-42dc-ab0e-348caf08e47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1459139863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d757093e-3b52-44bd-931c-64d7227b1878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f813e272c5a2404489f3cb99d2f36eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:03Z,use_quota=True,user_id='5c6c594a5cdd44a8b16b6ba2ec698541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d87a5d9-3d42-4abc-8c9f-f2b535471fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d87a5d9-3d42-4abc-8c9f-f2b535471fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8311b2ab-dea7-47c5-a895-43110826b281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 23:58:03 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961 1073741824" returned: 0 in 0.687s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:03 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961 Sep 01 23:58:03 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Acquiring lock "cinder-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Lock "cinder-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8311b2ab-dea7-47c5-a895-43110826b281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd757093e-3b52-44bd-931c-64d7227b1878', 'volume_name': 'volume-d757093e-3b52-44bd-931c-64d7227b1878', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8025bbc3-a4ba-4d6b-aff3-dc925a479c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8025bbc3-a4ba-4d6b-aff3-dc925a479c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb09356-0a13-4d23-92aa-d6f1ea8fbd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Volume d757093e-3b52-44bd-931c-64d7227b1878: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d757093e-3b52-44bd-931c-64d7227b1878', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Trying to clone d757093e-3b52-44bd-931c-64d7227b1878 from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Acquiring lock "cinder-quobyte-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Lock "cinder-quobyte-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5" acquired by "delete_volume" :: waited 0.050s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:03 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961" returned: 0 in 0.463s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ae8595-a15e-4367-8e77-64022eecb2d6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8be9576-0092-44ac-b92f-619b4ccf8d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992d0d44-c493-475f-988f-5bd8105b9961', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa7be0e-d79c-4175-b4a8-6e9af6f21498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Volume volume-992d0d44-c493-475f-988f-5bd8105b9961 (992d0d44-c493-475f-988f-5bd8105b9961): created successfully Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa7be0e-d79c-4175-b4a8-6e9af6f21498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Flow 'volume_create_manager' (2d398a89-7f7d-40bb-83f1-9228cde6bbd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-843c097b-7541-44ae-ab42-499e3f0f4d8b tempest-ServersNegativeTestJSON-415133903 None] Created volume successfully. Sep 01 23:58:04 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 Sep 01 23:58:04 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 23:58:04 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Image download 20.69 MB at 20.69 MB/s Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b668fc6a-1b0c-4034-a8ee-85b09b51b1db]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:04 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD Sep 01 23:58:04 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:04 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5" returned: 0 in 0.694s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:04 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5 Sep 01 23:58:04 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:04 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 is fetched for user 5c6c594a5cdd44a8b16b6ba2ec698541. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 23:58:04 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5" returned: 0 in 0.357s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Lock "cinder-quobyte-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5" released by "delete_volume" :: held 1.129s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[990bee17-ba2f-4026-a219-ffcac56aa6c0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:04 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Created reservations ['b4f51fe4-6c20-4982-b614-07d0948319ca', 'f63e2da8-08ae-40f3-a263-01819e1d994b', 'a138e082-81f2-40f9-a231-0144891b83ee', '90be45f4-06af-4753-92e0-c3cdc10275d8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:05 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD Sep 01 23:58:05 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:05 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:05 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:05 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1459139863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d757093e-3b52-44bd-931c-64d7227b1878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f813e272c5a2404489f3cb99d2f36eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:03Z,use_quota=True,user_id='5c6c594a5cdd44a8b16b6ba2ec698541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Creating volume d757093e-3b52-44bd-931c-64d7227b1878 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:05 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:05 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 1073741824 Sep 01 23:58:05 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "cinder-992d0d44-c493-475f-988f-5bd8105b9961-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Lock "cinder-992d0d44-c493-475f-988f-5bd8105b9961-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:05 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Deleted volume successfully. Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e295d19b-0b59-4216-8d38-928f392aa0a4 tempest-VolumesActionsTest-936082220 None] Lock "cinder-22424c6b-b5b3-4603-a053-b6d9cf7c7ea5-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "cinder-quobyte-992d0d44-c493-475f-988f-5bd8105b9961" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Lock "cinder-quobyte-992d0d44-c493-475f-988f-5bd8105b9961" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[df88e36a-b37b-480a-a48e-322bf8e6ec59]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:05 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961 Sep 01 23:58:05 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:05 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 1073741824" returned: 0 in 0.558s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:05 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 Sep 01 23:58:05 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:06 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961" returned: 0 in 0.440s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:06 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961 Sep 01 23:58:06 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:06 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878" returned: 0 in 0.348s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Attempting download of 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume d757093e-3b52-44bd-931c-64d7227b1878. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 23:58:06 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-992d0d44-c493-475f-988f-5bd8105b9961" returned: 0 in 0.426s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[270aa75b-6703-4e04-8c65-2b0f9585560a]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_ppg1mcri {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Lock "cinder-quobyte-992d0d44-c493-475f-988f-5bd8105b9961" released by "delete_volume" :: held 0.924s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:06 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:06 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (5dfff32f-069a-4458-8250-7f5d2dafa78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:06 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_ppg1mcri Sep 01 23:58:06 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a37cc9-2a81-4110-b7f8-eb4f6a72deeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a37cc9-2a81-4110-b7f8-eb4f6a72deeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735760258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0c4d9b-5931-45de-b4a0-08d24bfc22ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:06Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce81996-0c3a-4d90-b19c-fcee8355fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce81996-0c3a-4d90-b19c-fcee8355fff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d765ba-e3de-4e3e-a807-b2cae92853cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d765ba-e3de-4e3e-a807-b2cae92853cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f0c4d9b-5931-45de-b4a0-08d24bfc22ad', 'volume_name': 'volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ce2c57-5257-4f5c-9375-27d24ab2625a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ce2c57-5257-4f5c-9375-27d24ab2625a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2df7363-51ab-41a3-ac7a-1530f42a54cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Volume 0f0c4d9b-5931-45de-b4a0-08d24bfc22ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad', 'volume_size': 1} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735760258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0c4d9b-5931-45de-b4a0-08d24bfc22ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:06Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Creating volume 0f0c4d9b-5931-45de-b4a0-08d24bfc22ad {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Created reservations ['4ba823ae-1dae-4ade-a6b5-b5712712b46f', 'c0d38755-465d-4dbb-abad-58a896b35641', '6105549a-949e-4b43-b51b-f780eb7ee6fe', '40a1a90b-d19d-431e-807c-81d95660124c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:06 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad 1073741824 Sep 01 23:58:06 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:06 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_ppg1mcri" returned: 0 in 0.468s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_ppg1mcri {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:06 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:07 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:07 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:07 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_ppg1mcri Sep 01 23:58:07 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:07 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:07 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.325s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_ppg1mcri" returned: 1 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_ppg1mcri' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad917aad-172a-4547-a2d5-a6ad98d6693a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Deleted volume successfully. Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9797f33-bf3d-4451-9da8-ef20f13b1981 tempest-ServersNegativeTestJSON-415133903 None] Lock "cinder-992d0d44-c493-475f-988f-5bd8105b9961-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:07 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad 1073741824" returned: 0 in 0.647s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:07 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD Sep 01 23:58:07 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:07 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad Sep 01 23:58:07 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:07 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] 7ac8008a-9a50-4a29-8129-58d061cbfda5 was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:07 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad" returned: 0 in 0.308s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:07 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 Sep 01 23:58:07 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2df7363-51ab-41a3-ac7a-1530f42a54cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9252063e-4787-4cea-bfce-273f85fb5b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "cinder-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Volume volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad (0f0c4d9b-5931-45de-b4a0-08d24bfc22ad): created successfully Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9252063e-4787-4cea-bfce-273f85fb5b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (5dfff32f-069a-4458-8250-7f5d2dafa78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0b26fcda-41ac-4349-bd3b-cffa8c67403e tempest-VolumesActionsTest-1265680344 None] Created volume successfully. Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Lock "cinder-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "cinder-quobyte-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Lock "cinder-quobyte-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e214d088-7774-462d-a3f8-91397e20cb60]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:08 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea Sep 01 23:58:08 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:08 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea" returned: 0 in 0.423s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:08 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea Sep 01 23:58:08 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:08 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea" returned: 0 in 0.353s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Lock "cinder-quobyte-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea" released by "delete_volume" :: held 0.822s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:08 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Created reservations ['584feff2-33c9-4a7e-a9e9-7a39d9278094', 'f0a10381-d360-4290-b68d-33ad88b14ea9', 'e40a43b3-3982-4ed2-bb60-7cfc25692274', '46cd4f51-efaf-4ad8-9adf-660da175d74c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Acquiring lock "cinder-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Lock "cinder-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Acquiring lock "cinder-quobyte-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Lock "cinder-quobyte-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f64cf3d-3136-4dbb-87ba-4b39ff7ab8e2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:09 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:09 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:09 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad Sep 01 23:58:09 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:09 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.419s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Deleted volume successfully. Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d9471409-4bc9-48bc-ba0a-97c3df1805b8 tempest-ServersNegativeTestJSON-415133903 None] Lock "cinder-aeefc18b-76f9-4686-9cf6-5d76ffe9d2ea-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:09 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad" returned: 0 in 0.589s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:09 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad Sep 01 23:58:09 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:10 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Lock "cinder-quobyte-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad" released by "delete_volume" :: held 1.188s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:10 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878" returned: 0 in 2.493s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_gbrnn_uwdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 23:58:10 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Converted 112.00 MB image at 44.91 MB/s Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:10 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 1G Sep 01 23:58:10 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Created reservations ['94b09e02-71f3-4098-8326-17bbcfe206b9', '58389a2c-0d5b-45fb-ae09-3e75f1de57a5', '5527dce8-e52e-4e17-865d-5b304f7ed6e4', '65759f4f-2115-49d1-aafc-5b4cf2b5bfc4'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:10 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:10 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:10 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.332s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Deleted volume successfully. Sep 01 23:58:10 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 1G" returned: 0 in 0.675s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Downloaded image 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume d757093e-3b52-44bd-931c-64d7227b1878 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 for user 5c6c594a5cdd44a8b16b6ba2ec698541 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Marking volume d757093e-3b52-44bd-931c-64d7227b1878 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-99360ad4-3083-4fee-9200-319481e12765 tempest-VolumesActionsTest-936082220 None] Lock "cinder-0f0c4d9b-5931-45de-b4a0-08d24bfc22ad-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Copying metadata from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 to d757093e-3b52-44bd-931c-64d7227b1878. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 23:58:10 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Creating volume glance metadata for volume d757093e-3b52-44bd-931c-64d7227b1878 backed by image 7ac8008a-9a50-4a29-8129-58d061cbfda5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb09356-0a13-4d23-92aa-d6f1ea8fbd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d757093e-3b52-44bd-931c-64d7227b1878', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0df4288-c2c6-4dfe-abd3-36b5b24fc656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Volume volume-d757093e-3b52-44bd-931c-64d7227b1878 (d757093e-3b52-44bd-931c-64d7227b1878): created successfully Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0df4288-c2c6-4dfe-abd3-36b5b24fc656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Flow 'volume_create_manager' (0ac0e504-87b5-4b42-bf99-25860730f175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a3f6a3ef-479e-4701-b553-290cbf4acf63 tempest-VolumesImageMetadata-149181770 None] Created volume successfully. Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (f10e7113-053b-4c65-9d77-220404160f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bdb014-7408-43ea-bf7a-62c17b5f4720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bdb014-7408-43ea-bf7a-62c17b5f4720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-372864663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3017f456-ea84-4627-88ff-6b8c23bfb9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:12Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdd737a-3c41-455a-9399-ff88d1dfa47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdd737a-3c41-455a-9399-ff88d1dfa47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfd360c-5652-4b15-bbdd-b1b6748c57e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfd360c-5652-4b15-bbdd-b1b6748c57e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3017f456-ea84-4627-88ff-6b8c23bfb9cc', 'volume_name': 'volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b787769-ac8f-40c1-83d8-b3a2dd055a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b787769-ac8f-40c1-83d8-b3a2dd055a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519e732b-846d-4dc9-a5e7-5a152ec12cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Volume 3017f456-ea84-4627-88ff-6b8c23bfb9cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc', 'volume_size': 1} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-372864663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3017f456-ea84-4627-88ff-6b8c23bfb9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:12Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Creating volume 3017f456-ea84-4627-88ff-6b8c23bfb9cc {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:12 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:12 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc 1073741824 Sep 01 23:58:12 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Acquiring lock "cinder-d757093e-3b52-44bd-931c-64d7227b1878-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Lock "cinder-d757093e-3b52-44bd-931c-64d7227b1878-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Acquiring lock "cinder-quobyte-d757093e-3b52-44bd-931c-64d7227b1878" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Lock "cinder-quobyte-d757093e-3b52-44bd-931c-64d7227b1878" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88ac90b-ca0e-4a05-8974-eae0cdb6218c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:12 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 Sep 01 23:58:12 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:12 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc 1073741824" returned: 0 in 0.795s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:12 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc Sep 01 23:58:12 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:12 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878" returned: 0 in 0.578s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:12 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878 Sep 01 23:58:12 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:13 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc" returned: 0 in 0.259s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519e732b-846d-4dc9-a5e7-5a152ec12cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68053cd1-daae-49ca-9335-28fd607c2bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:13 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Volume volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc (3017f456-ea84-4627-88ff-6b8c23bfb9cc): created successfully Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68053cd1-daae-49ca-9335-28fd607c2bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (f10e7113-053b-4c65-9d77-220404160f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3c9c5ab1-71f0-4791-ab01-2e2acf6833bc tempest-VolumesActionsTest-1265680344 None] Created volume successfully. Sep 01 23:58:13 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d757093e-3b52-44bd-931c-64d7227b1878" returned: 0 in 0.249s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Lock "cinder-quobyte-d757093e-3b52-44bd-931c-64d7227b1878" released by "delete_volume" :: held 0.884s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Created reservations ['44a0b853-e8f2-4137-9296-0f4f2db6ab61', 'ab9d4ce5-2925-4b0a-adf6-1002fc2cde16', 'ae3dad6f-0dad-4ae8-89f6-7eecc9fb152d', '6b21e627-18be-4875-ae68-d3e8c3b76cd6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:13 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:13 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:13 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.251s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Deleted volume successfully. Sep 01 23:58:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1f953a8-c001-413e-87c4-c3dde8491c0b tempest-VolumesImageMetadata-149181770 None] Lock "cinder-d757093e-3b52-44bd-931c-64d7227b1878-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Acquiring lock "cinder-3017f456-ea84-4627-88ff-6b8c23bfb9cc-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Lock "cinder-3017f456-ea84-4627-88ff-6b8c23bfb9cc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Acquiring lock "cinder-quobyte-3017f456-ea84-4627-88ff-6b8c23bfb9cc" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Lock "cinder-quobyte-3017f456-ea84-4627-88ff-6b8c23bfb9cc" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b214a8d2-5a5d-4913-9d60-0998a0ef0855]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:14 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc Sep 01 23:58:14 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:14 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:14 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc Sep 01 23:58:14 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:15 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3017f456-ea84-4627-88ff-6b8c23bfb9cc" returned: 0 in 0.261s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Lock "cinder-quobyte-3017f456-ea84-4627-88ff-6b8c23bfb9cc" released by "delete_volume" :: held 0.768s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Created reservations ['5b8bbcc6-e250-4d76-8cd9-9275f443769f', '37457da1-54a8-4ba6-90e8-783cd4059714', '6be2d0ef-eb90-49cc-b72a-0b318d3403c0', 'c49a0df9-e977-4365-8217-7d2dab6c7e24'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:15 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:15 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:15 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Deleted volume successfully. Sep 01 23:58:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a78d746f-68de-4517-81b2-a952d91dc6fc tempest-VolumesActionsTest-936082220 None] Lock "cinder-3017f456-ea84-4627-88ff-6b8c23bfb9cc-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (9e8455e2-2221-494d-98d2-f814468597a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdf0037-9b3f-4355-ab5b-d0d515869563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdf0037-9b3f-4355-ab5b-d0d515869563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1884166637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd371d4-a524-4ea5-8cdc-efd2c1f240f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:16Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf1d0dc-43f2-4442-b5a3-6c9de3b22695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf1d0dc-43f2-4442-b5a3-6c9de3b22695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841adca3-b64c-43f8-95a8-9b14d55b4204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841adca3-b64c-43f8-95a8-9b14d55b4204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd371d4-a524-4ea5-8cdc-efd2c1f240f8', 'volume_name': 'volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832153f3-e688-440f-83d7-1d3284573b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832153f3-e688-440f-83d7-1d3284573b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e2904b-5668-4bfc-9079-545e8874dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Volume bfd371d4-a524-4ea5-8cdc-efd2c1f240f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8', 'volume_size': 1} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1884166637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd371d4-a524-4ea5-8cdc-efd2c1f240f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d739271cf24442bcc6cd2a7e4c8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:16Z,use_quota=True,user_id='641fb9ba90f84e298118892b59b0543f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Creating volume bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:16 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:16 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 1073741824 Sep 01 23:58:16 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:16 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 1073741824" returned: 0 in 0.552s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:16 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 Sep 01 23:58:16 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Flow 'volume_create_manager' (e3589cc3-a48c-4fb9-8792-e7d368501343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670a9f1b-3739-45fd-969d-b88f26d034fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670a9f1b-3739-45fd-969d-b88f26d034fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1883690547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338c549e-20c1-48d6-9ca3-f0972c1081a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e2c507d60864c318a577a3bd5c5c7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:17Z,use_quota=True,user_id='fa0a40855e7746dfb70be597da7af9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3aafc8-e544-43f3-a451-1024186f7063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3aafc8-e544-43f3-a451-1024186f7063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af27d773-a573-4410-a9e0-b02f5f942cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af27d773-a573-4410-a9e0-b02f5f942cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '338c549e-20c1-48d6-9ca3-f0972c1081a7', 'volume_name': 'volume-338c549e-20c1-48d6-9ca3-f0972c1081a7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca542667-49c1-4351-be2e-3fc1536f3e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca542667-49c1-4351-be2e-3fc1536f3e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b613e0-71da-4ba0-ab7e-778eb11476b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Volume 338c549e-20c1-48d6-9ca3-f0972c1081a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-338c549e-20c1-48d6-9ca3-f0972c1081a7', 'volume_size': 1} Sep 01 23:58:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:17 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1883690547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338c549e-20c1-48d6-9ca3-f0972c1081a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e2c507d60864c318a577a3bd5c5c7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:17Z,use_quota=True,user_id='fa0a40855e7746dfb70be597da7af9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Creating volume 338c549e-20c1-48d6-9ca3-f0972c1081a7 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:17 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e2904b-5668-4bfc-9079-545e8874dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a00d8c-e20f-4bec-b269-98dffc2d6625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:17 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 1073741824 Sep 01 23:58:17 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Volume volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 (bfd371d4-a524-4ea5-8cdc-efd2c1f240f8): created successfully Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a00d8c-e20f-4bec-b269-98dffc2d6625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Flow 'volume_create_manager' (9e8455e2-2221-494d-98d2-f814468597a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-250fe88e-2ed3-4e81-adc0-f6f92561e3c3 tempest-VolumesActionsTest-1265680344 None] Created volume successfully. Sep 01 23:58:17 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 1073741824" returned: 0 in 0.487s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:17 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 Sep 01 23:58:17 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:18 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7" returned: 0 in 0.385s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b613e0-71da-4ba0-ab7e-778eb11476b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-338c549e-20c1-48d6-9ca3-f0972c1081a7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ae4a78-e38a-46b3-8e9b-967acffb4492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Volume volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 (338c549e-20c1-48d6-9ca3-f0972c1081a7): created successfully Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ae4a78-e38a-46b3-8e9b-967acffb4492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Flow 'volume_create_manager' (e3589cc3-a48c-4fb9-8792-e7d368501343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1c2fc63f-1c97-4538-9675-6f479ef223be tempest-SnapshotMetadataTestJSON-173481839 None] Created volume successfully. Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "cinder-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "cinder-quobyte-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-quobyte-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19cb00b-12fe-49d6-9d2d-7d22a1fdfbb7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:19 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 Sep 01 23:58:19 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Creating offline snapshot 55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 of volume 338c549e-20c1-48d6-9ca3-f0972c1081a7 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0efb4b-f01e-4b30-b4f7-5a9cbe91579b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:19 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 Sep 01 23:58:19 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:19 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8" returned: 0 in 0.493s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:19 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8 Sep 01 23:58:19 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:19 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:19 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-quobyte-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8" released by "delete_volume" :: held 0.851s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:19 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 1G Sep 01 23:58:19 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Created reservations ['10469c15-81af-4f5c-99c6-3983fd9b60b6', '5c65524d-d89a-46fa-8761-190549b15ce7', 'b8edc37f-44ad-42ef-bafe-cba52560d5f0', 'defdef46-e82d-4a43-bee1-9db8be17b7da'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:19 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:19 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:20 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 1G" returned: 0 in 0.579s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:20 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.458s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:20 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Deleted volume successfully. Sep 01 23:58:20 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 Sep 01 23:58:20 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521d2092-1484-4e98-af3e-67ec30620a73 tempest-VolumesActionsTest-1265680344 None] Lock "cinder-bfd371d4-a524-4ea5-8cdc-efd2c1f240f8-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:20 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4" returned: 0 in 0.483s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:20 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 is being set with open permissions: ugo+rw Sep 01 23:58:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:20 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 Sep 01 23:58:20 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:21 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4" returned: 0 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:21 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.info Sep 01 23:58:21 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:21 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.info" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:21 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.info is being set with open permissions: ugo+rw Sep 01 23:58:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:21 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.info Sep 01 23:58:21 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:21 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.info" returned: 0 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-26152485-b596-4aed-bdfe-290bd7d31421 tempest-SnapshotMetadataTestJSON-173481839 None] Create snapshot completed successfully Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Acquiring lock "cinder-55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Acquiring lock "cinder-quobyte-338c549e-20c1-48d6-9ca3-f0972c1081a7" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-quobyte-338c549e-20c1-48d6-9ca3-f0972c1081a7" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Acquiring lock "cinder-quobyte-55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-quobyte-55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Deleting offline snapshot 55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 of volume 338c549e-20c1-48d6-9ca3-f0972c1081a7 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] snapshot_file for this snap is: volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fa552a-2453-4697-82fb-51fcd2d444cc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:23 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 Sep 01 23:58:23 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Flow 'volume_create_manager' (84b56ec0-f48b-430b-b4d8-fa7b1e67fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e5ea90-cc0b-4142-9dd6-aacff25ba6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e5ea90-cc0b-4142-9dd6-aacff25ba6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1087410306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea39baa2f294924bca2f2a248c3480c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:24Z,use_quota=True,user_id='d556b79964c94178a54f7e3e0b75d451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c850ef-9220-406d-94f6-3f92550bc2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c850ef-9220-406d-94f6-3f92550bc2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a211ee-dc88-40fc-8efb-04032caf65a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a211ee-dc88-40fc-8efb-04032caf65a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6', 'volume_name': 'volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9056110a-3ffa-4735-af72-00f209673508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9056110a-3ffa-4735-af72-00f209673508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08aa8887-cafb-4f3d-b433-680796f6252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Volume 0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6', 'volume_size': 1} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1087410306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea39baa2f294924bca2f2a248c3480c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:24Z,use_quota=True,user_id='d556b79964c94178a54f7e3e0b75d451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Creating volume 0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:23 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:23 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 1073741824 Sep 01 23:58:23 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:24 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4" returned: 0 in 0.416s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-338c549e-20c1-48d6-9ca3-f0972c1081a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6234488d-094e-4f9d-a0bb-96d519af38bb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:24 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 Sep 01 23:58:24 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:24 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 1073741824" returned: 0 in 0.508s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:24 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 Sep 01 23:58:24 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:24 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7" returned: 0 in 0.434s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:24 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 Sep 01 23:58:24 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:24 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6" returned: 0 in 0.313s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08aa8887-cafb-4f3d-b433-680796f6252e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537f6327-23af-4829-817f-99eac11a4ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Volume volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 (0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6): created successfully Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537f6327-23af-4829-817f-99eac11a4ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Flow 'volume_create_manager' (84b56ec0-f48b-430b-b4d8-fa7b1e67fead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a87494c3-bcfd-4e56-bdb1-7fd6145bfb79 tempest-AttachVolumeTestJSON-1975745419 None] Created volume successfully. Sep 01 23:58:25 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4" returned: 0 in 0.511s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:25 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4 Sep 01 23:58:25 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:25 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7.55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-quobyte-55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4" released by "_delete_snapshot" :: held 1.823s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-quobyte-338c549e-20c1-48d6-9ca3-f0972c1081a7" released by "delete_snapshot" :: held 1.885s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Created reservations ['f42fa50c-2541-47bb-8890-0a11fa33d84c', '4e8c8712-da2f-4895-91cc-e6b3d5368dae', '66707770-012b-416b-86bc-b9e3e6503387', '4d07d984-3c02-4f34-a256-413398c51fa3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Delete snapshot completed successfully. Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d18556b1-1647-497f-be71-f9b14dccb043 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-55a1bcd8-88d6-4fb7-bfba-8b40f7477fd4-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Acquiring lock "cinder-338c549e-20c1-48d6-9ca3-f0972c1081a7-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-338c549e-20c1-48d6-9ca3-f0972c1081a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Acquiring lock "cinder-quobyte-338c549e-20c1-48d6-9ca3-f0972c1081a7" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-quobyte-338c549e-20c1-48d6-9ca3-f0972c1081a7" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8438bb3-487d-44ee-a511-0cbe148ff932]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:26 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 Sep 01 23:58:26 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:26 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7" returned: 0 in 0.545s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:26 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7 Sep 01 23:58:26 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:26 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-338c549e-20c1-48d6-9ca3-f0972c1081a7" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-quobyte-338c549e-20c1-48d6-9ca3-f0972c1081a7" released by "delete_volume" :: held 0.995s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-7fb14a85-98a0-4d3f-a46e-8264a3f77fef req-fcd1ee92-81db-46a6-ac5d-d7adbe8f30c0 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-7fb14a85-98a0-4d3f-a46e-8264a3f77fef req-fcd1ee92-81db-46a6-ac5d-d7adbe8f30c0 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-7fb14a85-98a0-4d3f-a46e-8264a3f77fef req-fcd1ee92-81db-46a6-ac5d-d7adbe8f30c0 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-7fb14a85-98a0-4d3f-a46e-8264a3f77fef req-fcd1ee92-81db-46a6-ac5d-d7adbe8f30c0 tempest-AttachVolumeTestJSON-1975745419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0580ac0-eb3c-44cb-ba00-69eed3ed01a4', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 23:58:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Created reservations ['c700e032-0bae-4050-965d-615fa8d23227', '0d673783-78b6-4bac-b4c6-641fe772e6dd', '362d3a25-9d84-4e3a-8766-90692d8c90e0', '07322866-404a-438c-91fe-3187532394b2'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-7fb14a85-98a0-4d3f-a46e-8264a3f77fef req-fcd1ee92-81db-46a6-ac5d-d7adbe8f30c0 tempest-AttachVolumeTestJSON-1975745419 None] attachment_update completed successfully. Sep 01 23:58:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:27 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:27 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:27 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:27 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Deleted volume successfully. Sep 01 23:58:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fc29c022-995d-434a-a709-6240bedf94d1 tempest-SnapshotMetadataTestJSON-173481839 None] Lock "cinder-338c549e-20c1-48d6-9ca3-f0972c1081a7-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Flow 'volume_create_manager' (cf137e81-0120-45c1-ba8a-124200ced427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdbfcea-482e-4db2-8b6f-d0f989332a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdbfcea-482e-4db2-8b6f-d0f989332a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-94124118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41b0a58-5ecb-4b29-84d2-3db49a39aa07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5f24c148af485a9d01cce35a6659c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:34Z,use_quota=True,user_id='93b4311138d7405297111fc743ef1676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15a22b1-612e-4996-8cc2-a8921f4480d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15a22b1-612e-4996-8cc2-a8921f4480d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ff587e-caf9-4b87-814e-8478bfffe594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ff587e-caf9-4b87-814e-8478bfffe594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41b0a58-5ecb-4b29-84d2-3db49a39aa07', 'volume_name': 'volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7cb478f-6214-484a-ad9d-3fea0b7f8c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7cb478f-6214-484a-ad9d-3fea0b7f8c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b86dfc8-b78d-469a-a1f3-72b144754dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Volume b41b0a58-5ecb-4b29-84d2-3db49a39aa07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07', 'volume_size': 1} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-94124118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41b0a58-5ecb-4b29-84d2-3db49a39aa07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5f24c148af485a9d01cce35a6659c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:34Z,use_quota=True,user_id='93b4311138d7405297111fc743ef1676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Creating volume b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:34 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:34 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 1073741824 Sep 01 23:58:34 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:35 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 1073741824" returned: 0 in 0.591s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:35 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 Sep 01 23:58:35 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:35 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" returned: 0 in 0.410s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b86dfc8-b78d-469a-a1f3-72b144754dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621f4940-706f-4b6e-a145-d026543b38e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Volume volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 (b41b0a58-5ecb-4b29-84d2-3db49a39aa07): created successfully Sep 01 23:58:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621f4940-706f-4b6e-a145-d026543b38e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Flow 'volume_create_manager' (cf137e81-0120-45c1-ba8a-124200ced427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5995ab1c-f06e-4afc-ad03-e26ff8ef5f9c tempest-VolumesSnapshotListTestJSON-1196158349 None] Created volume successfully. Sep 01 23:58:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Creating offline snapshot 6fb47159-315b-4b4d-a348-7c18e468a23d of volume b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:58:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[03869b9b-91c7-4c29-bf9a-414f48371fd8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:37 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 Sep 01 23:58:37 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:37 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" returned: 0 in 0.550s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:37 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d 1G Sep 01 23:58:37 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:38 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d 1G" returned: 0 in 0.640s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:38 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d Sep 01 23:58:38 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:38 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d" returned: 0 in 0.668s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:38 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d is being set with open permissions: ugo+rw Sep 01 23:58:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:38 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d Sep 01 23:58:38 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:39 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:39 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=105,cinder:UPDATE=128,cinder:INSERT=38,cinder:DELETE=16 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:58:39 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=133,cinder:SELECT=109,cinder:INSERT=34,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:58:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:39 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.info Sep 01 23:58:39 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:40 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.info" returned: 0 in 0.677s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:40 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.info is being set with open permissions: ugo+rw Sep 01 23:58:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:40 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.info Sep 01 23:58:40 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:40 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.info" returned: 0 in 0.466s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.702s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b05538d0-c011-4bba-b4bc-3bd769cb7360 tempest-VolumesSnapshotListTestJSON-1196158349 None] Create snapshot completed successfully Sep 01 23:58:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Creating offline snapshot 22bb6c12-e6b0-4db9-b058-4f017c4f2383 of volume b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:58:41 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5286cce7-5cd2-4f7b-b8f0-286599aa98ac]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:41 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d Sep 01 23:58:41 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:42 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:58:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:42 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 1G Sep 01 23:58:42 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:42 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 1G" returned: 0 in 0.675s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:42 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 Sep 01 23:58:42 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:43 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383" returned: 0 in 0.374s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:43 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 is being set with open permissions: ugo+rw Sep 01 23:58:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:43 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 Sep 01 23:58:43 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:43 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383" returned: 0 in 0.633s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-83766f29-bcad-4c2a-8e92-7efc80ff9b45 tempest-VolumesSnapshotListTestJSON-1196158349 None] Create snapshot completed successfully Sep 01 23:58:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Creating offline snapshot 5e99bc54-362b-4b23-acec-23e0964a9a09 of volume b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:58:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3515ce-e239-4b81-899b-561b75db5539]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:45 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 Sep 01 23:58:45 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:46 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383" returned: 0 in 0.626s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:58:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:46 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 1G Sep 01 23:58:46 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:46 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 1G" returned: 0 in 0.778s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:46 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 Sep 01 23:58:46 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:47 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:47 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 is being set with open permissions: ugo+rw Sep 01 23:58:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:47 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 Sep 01 23:58:47 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:47 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09" returned: 0 in 0.533s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b7afe7e7-77b2-4f82-ab14-3017c7d82fe7 tempest-VolumesSnapshotListTestJSON-1196158349 None] Create snapshot completed successfully Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-5e99bc54-362b-4b23-acec-23e0964a9a09-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-5e99bc54-362b-4b23-acec-23e0964a9a09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-quobyte-5e99bc54-362b-4b23-acec-23e0964a9a09" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-5e99bc54-362b-4b23-acec-23e0964a9a09" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Deleting offline snapshot 5e99bc54-362b-4b23-acec-23e0964a9a09 of volume b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] snapshot_file for this snap is: volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfab20c3-75a0-47f0-ab9f-31e129de9e17]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:50 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 Sep 01 23:58:50 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:51 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09" returned: 0 in 0.480s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:58:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b5bc97-bb8e-44cc-9912-de294bf47df5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:51 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 Sep 01 23:58:51 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:51 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383" returned: 0 in 0.475s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:58:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:51 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 Sep 01 23:58:51 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:52 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09" returned: 0 in 0.496s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:52 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09 Sep 01 23:58:52 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:52 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.5e99bc54-362b-4b23-acec-23e0964a9a09" returned: 0 in 0.418s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-5e99bc54-362b-4b23-acec-23e0964a9a09" released by "_delete_snapshot" :: held 1.986s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" released by "delete_snapshot" :: held 2.034s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:52 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Created reservations ['560e5d53-2a42-4520-8f93-a20d3282c200', '3c20671d-dea4-493a-a3ca-7d1a6fdcd63c', 'ea69449a-add9-4bae-8688-3e2673d6626b', 'e6b89218-b27b-478e-bcbe-cb684ec480e7'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Delete snapshot completed successfully. Sep 01 23:58:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c67589-2e45-4bf6-848f-57e0e9944ed5 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-5e99bc54-362b-4b23-acec-23e0964a9a09-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-22bb6c12-e6b0-4db9-b058-4f017c4f2383-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-22bb6c12-e6b0-4db9-b058-4f017c4f2383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-quobyte-22bb6c12-e6b0-4db9-b058-4f017c4f2383" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-22bb6c12-e6b0-4db9-b058-4f017c4f2383" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Deleting offline snapshot 22bb6c12-e6b0-4db9-b058-4f017c4f2383 of volume b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] snapshot_file for this snap is: volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[472d6628-e19c-493d-91a9-52413fc88f5b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:54 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 Sep 01 23:58:54 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:54 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383" returned: 0 in 0.514s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[20536ff8-4b32-4635-80a3-33c4da61d3c7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Flow 'volume_create_manager' (2cc8181e-031d-47df-8035-bf0ac712a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb476fb-c5c5-42f6-a4d7-54ef93faec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:54 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d Sep 01 23:58:54 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb476fb-c5c5-42f6-a4d7-54ef93faec46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1304618587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040e2826d97943a49365da0df9e519fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:55Z,use_quota=True,user_id='f76ec6dbd7b8428ea2e63654e927003d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e517ea7-19ed-4275-a9a4-88d62a0f95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e517ea7-19ed-4275-a9a4-88d62a0f95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d53e802-ced7-485e-b941-6362a8e626f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d53e802-ced7-485e-b941-6362a8e626f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24', 'volume_name': 'volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32648282-0735-4272-ae6c-ae87466b6121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32648282-0735-4272-ae6c-ae87466b6121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aad582-7fcc-410d-af27-6514e1b25d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Volume 4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24', 'volume_size': 1} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1304618587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040e2826d97943a49365da0df9e519fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:55Z,use_quota=True,user_id='f76ec6dbd7b8428ea2e63654e927003d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Creating volume 4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:54 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 1073741824 Sep 01 23:58:54 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:55 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d" returned: 0 in 0.369s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:55 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 Sep 01 23:58:55 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:55 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 1073741824" returned: 0 in 0.408s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:55 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 Sep 01 23:58:55 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:55 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383" returned: 0 in 0.407s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:55 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383 Sep 01 23:58:55 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:55 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aad582-7fcc-410d-af27-6514e1b25d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8da7e27-0c62-4553-afcb-8c150aec0cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Volume volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 (4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24): created successfully Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8da7e27-0c62-4553-afcb-8c150aec0cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Flow 'volume_create_manager' (2cc8181e-031d-47df-8035-bf0ac712a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-92f4c7ae-45fc-4769-864a-81d33ca81b04 tempest-VolumesTransfersV355Test-662003359 None] Created volume successfully. Sep 01 23:58:55 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.22bb6c12-e6b0-4db9-b058-4f017c4f2383" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-22bb6c12-e6b0-4db9-b058-4f017c4f2383" released by "_delete_snapshot" :: held 1.692s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" released by "delete_snapshot" :: held 1.749s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:55 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Created reservations ['fa2a96ea-eb26-49bd-a04c-bb20ebcc3348', 'cbd7efff-9289-406b-93af-33853778313a', '75e1b103-54bc-4548-8e93-042d846e9b4c', '571df267-2667-4be6-9e6d-22f105c5b72f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Delete snapshot completed successfully. Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e3b3f46-4362-4477-8e0a-4141a29d7c2d tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-22bb6c12-e6b0-4db9-b058-4f017c4f2383-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-6fb47159-315b-4b4d-a348-7c18e468a23d-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-6fb47159-315b-4b4d-a348-7c18e468a23d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-quobyte-6fb47159-315b-4b4d-a348-7c18e468a23d" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-6fb47159-315b-4b4d-a348-7c18e468a23d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Deleting offline snapshot 6fb47159-315b-4b4d-a348-7c18e468a23d of volume b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] snapshot_file for this snap is: volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[731bca36-9709-4807-afcd-560988ec100f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:56 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d Sep 01 23:58:56 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-07853fba-6798-441d-b510-e58ab61bcb6b tempest-VolumesTransfersV355Test-1572061263 None] Transfer volume completed successfully. Sep 01 23:58:56 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d" returned: 0 in 0.466s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7134a1-9813-4d69-b3ef-12bf82c345cd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:56 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 Sep 01 23:58:56 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Acquiring lock "cinder-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Lock "cinder-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Acquiring lock "cinder-quobyte-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:57 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" returned: 0 in 0.478s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Lock "cinder-quobyte-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:57 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d Sep 01 23:58:57 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[804adb21-e512-489f-9ae0-3cb49d33e3b8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:57 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 Sep 01 23:58:57 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:57 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d" returned: 0 in 0.398s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:57 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d Sep 01 23:58:57 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:57 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:57 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24 Sep 01 23:58:57 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:57 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07.6fb47159-315b-4b4d-a348-7c18e468a23d" returned: 0 in 0.278s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:57 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-6fb47159-315b-4b4d-a348-7c18e468a23d" released by "_delete_snapshot" :: held 1.737s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24" returned: 0 in 0.269s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" released by "delete_snapshot" :: held 1.770s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Lock "cinder-quobyte-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24" released by "delete_volume" :: held 0.718s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Created reservations ['be55fd67-b470-4e7e-a536-cb4097f0fbac', '027b3562-4cf3-4d09-9fab-535b40ecfdb8', '44a3c853-7eb1-4bcf-a8f0-429f84db0566', 'ed87e279-ed19-4d1f-bb0e-386d371bd251'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Created reservations ['b6fdcf6e-95a4-4de2-9f02-fbe5094933ab', 'cdc64c6e-4a39-4800-b8a1-57b493340121', '4def277d-dd9c-4571-a301-c6be3e2b3dcd', 'ca302e7f-3649-48e8-9206-a297768e0b94'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Delete snapshot completed successfully. Sep 01 23:58:58 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:58 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f9713814-46d9-4397-9291-f6bfb5b75601 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-6fb47159-315b-4b4d-a348-7c18e468a23d-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:58 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-b41b0a58-5ecb-4b29-84d2-3db49a39aa07-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:58:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Deleted volume successfully. Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-b41b0a58-5ecb-4b29-84d2-3db49a39aa07-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c37d2467-9f98-499e-b4b8-b8a9ddc0825e tempest-VolumesTransfersV355Test-911234579 None] Lock "cinder-4b8a3a4a-215a-4f44-ac77-4eb43e5f8d24-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d0bda3-b90a-48ed-94ce-1cd14d15ba4a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:58 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 Sep 01 23:58:58 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Flow 'volume_create_manager' (1f221be3-6571-4601-b125-0419e16358de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:58:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812e35fa-2134-474d-99be-342930c88873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812e35fa-2134-474d-99be-342930c88873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-186992702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185a4991-e47d-47a7-a43c-eca48e24da0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040e2826d97943a49365da0df9e519fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:59Z,use_quota=True,user_id='f76ec6dbd7b8428ea2e63654e927003d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55e1158-bc12-4afe-bca3-b60917d944ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55e1158-bc12-4afe-bca3-b60917d944ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f07d810-f03e-4a14-bf41-dcbfbdf774c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f07d810-f03e-4a14-bf41-dcbfbdf774c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185a4991-e47d-47a7-a43c-eca48e24da0e', 'volume_name': 'volume-185a4991-e47d-47a7-a43c-eca48e24da0e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b9d40a-040b-462e-a338-a8653de2801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b9d40a-040b-462e-a338-a8653de2801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248b5a2d-f7e2-497e-9323-9b77cc1ed1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:58:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Volume 185a4991-e47d-47a7-a43c-eca48e24da0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185a4991-e47d-47a7-a43c-eca48e24da0e', 'volume_size': 1} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-186992702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185a4991-e47d-47a7-a43c-eca48e24da0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040e2826d97943a49365da0df9e519fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:58:59Z,use_quota=True,user_id='f76ec6dbd7b8428ea2e63654e927003d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Creating volume 185a4991-e47d-47a7-a43c-eca48e24da0e {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:58:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:59 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" returned: 0 in 0.384s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:59 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e 1073741824 Sep 01 23:58:59 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:59 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07 Sep 01 23:58:59 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:59 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" returned: 0 in 0.248s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-quobyte-b41b0a58-5ecb-4b29-84d2-3db49a39aa07" released by "delete_volume" :: held 0.697s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Created reservations ['5636ddaf-0e5c-4dc9-93cb-5d794484ef0e', 'da78c4a9-28aa-4c59-b0a2-3aae1fd5b320', '21e63a7f-216f-496d-9eac-e888a73896bd', '89c8bb48-2567-4691-a23c-48073331315d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:59 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:58:59 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:59 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e 1073741824" returned: 0 in 0.512s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:58:59 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e Sep 01 23:58:59 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:58:59 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.500s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:58:59 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:59:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Deleted volume successfully. Sep 01 23:59:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a05c599-d852-4272-aec3-15c365c18334 tempest-VolumesSnapshotListTestJSON-1196158349 None] Lock "cinder-b41b0a58-5ecb-4b29-84d2-3db49a39aa07-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:00 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e" returned: 0 in 0.399s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:59:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248b5a2d-f7e2-497e-9323-9b77cc1ed1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185a4991-e47d-47a7-a43c-eca48e24da0e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8daef5-fe6e-4f09-abd0-012b181c6a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Volume volume-185a4991-e47d-47a7-a43c-eca48e24da0e (185a4991-e47d-47a7-a43c-eca48e24da0e): created successfully Sep 01 23:59:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8daef5-fe6e-4f09-abd0-012b181c6a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Flow 'volume_create_manager' (1f221be3-6571-4601-b125-0419e16358de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:59:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e231057d-b9ae-4ee6-b8df-61834d3d94ed tempest-VolumesTransfersV355Test-662003359 None] Created volume successfully. Sep 01 23:59:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Acquiring lock "cinder-185a4991-e47d-47a7-a43c-eca48e24da0e-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Lock "cinder-185a4991-e47d-47a7-a43c-eca48e24da0e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Acquiring lock "cinder-quobyte-185a4991-e47d-47a7-a43c-eca48e24da0e" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Lock "cinder-quobyte-185a4991-e47d-47a7-a43c-eca48e24da0e" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb6bf45-911f-485a-ac35-01b2d92a6a85]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:59:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:01 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e Sep 01 23:59:01 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:01 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e" returned: 0 in 0.399s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:01 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e Sep 01 23:59:01 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:02 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-185a4991-e47d-47a7-a43c-eca48e24da0e" returned: 0 in 0.291s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Lock "cinder-quobyte-185a4991-e47d-47a7-a43c-eca48e24da0e" released by "delete_volume" :: held 0.734s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Created reservations ['c91db376-c76b-4933-ad4a-5705b40fdf5e', '612138e4-e514-4cea-aa0f-062f54740dfa', '61756d0d-dd4d-4033-84d0-2138b05b5cd3', 'caefcd44-09ad-4a92-82d8-345d06dda5e2'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:02 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:59:02 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:02 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.433s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:59:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Deleted volume successfully. Sep 01 23:59:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-974a64a7-bba7-4e51-9d86-147a80ed5c2c tempest-VolumesTransfersV355Test-911234579 None] Lock "cinder-185a4991-e47d-47a7-a43c-eca48e24da0e-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Flow 'volume_create_manager' (db299783-61be-41fa-845e-7e5cee090725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae13939-aad6-46cd-9b11-3d918bdb8a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae13939-aad6-46cd-9b11-3d918bdb8a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1289785890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7963549b-ad08-46ea-ac3f-1f87a5a771be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eed245065204fb2951b70dbec771e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:59:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:59:03Z,use_quota=True,user_id='1076e9c547274eb2a194722a729bbe41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6871343-f104-4e3b-9941-d1ca70d802e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6871343-f104-4e3b-9941-d1ca70d802e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1171aadd-686d-4b6e-aabd-f228f01341be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1171aadd-686d-4b6e-aabd-f228f01341be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7963549b-ad08-46ea-ac3f-1f87a5a771be', 'volume_name': 'volume-7963549b-ad08-46ea-ac3f-1f87a5a771be', 'volume_size': 2}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdaa449-7a9e-4801-982a-f6c5a9afe3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdaa449-7a9e-4801-982a-f6c5a9afe3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6f04ac-9e17-4189-9e13-3fdef3da981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Volume 7963549b-ad08-46ea-ac3f-1f87a5a771be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7963549b-ad08-46ea-ac3f-1f87a5a771be', 'volume_size': 2} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1289785890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7963549b-ad08-46ea-ac3f-1f87a5a771be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eed245065204fb2951b70dbec771e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:59:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:59:03Z,use_quota=True,user_id='1076e9c547274eb2a194722a729bbe41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Creating volume 7963549b-ad08-46ea-ac3f-1f87a5a771be {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:59:03 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:59:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be 2147483648 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:03 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be 2147483648 Sep 01 23:59:03 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:04 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be 2147483648" returned: 0 in 0.475s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:04 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be Sep 01 23:59:04 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:04 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be" returned: 0 in 0.254s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:59:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6f04ac-9e17-4189-9e13-3fdef3da981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7963549b-ad08-46ea-ac3f-1f87a5a771be', 'volume_size': 2}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514ad769-776e-46dc-908e-fe5a983540f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Volume volume-7963549b-ad08-46ea-ac3f-1f87a5a771be (7963549b-ad08-46ea-ac3f-1f87a5a771be): created successfully Sep 01 23:59:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514ad769-776e-46dc-908e-fe5a983540f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Flow 'volume_create_manager' (db299783-61be-41fa-845e-7e5cee090725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:59:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-04bd1d83-5ca3-4bf8-a4f6-adf9c4529631 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Created volume successfully. Sep 01 23:59:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-dd6022bf-097f-48c6-aeec-f918d0559939 req-fe83533c-1069-4265-8579-ca79b22361ff tempest-AttachVolumeTestJSON-1975745419 None] Terminate volume connection completed successfully. Sep 01 23:59:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-dd6022bf-097f-48c6-aeec-f918d0559939 req-fe83533c-1069-4265-8579-ca79b22361ff tempest-AttachVolumeTestJSON-1975745419 None] Deleting attachment f0580ac0-eb3c-44cb-ba00-69eed3ed01a4. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 23:59:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Creating offline snapshot 7c6d3833-d45b-455c-bc9b-79c5df620382 of volume 7963549b-ad08-46ea-ac3f-1f87a5a771be {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 23:59:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a314ed-b598-46fb-9147-e471cb2723db]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:59:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:05 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be Sep 01 23:59:05 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:06 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 2G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:06 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 2G Sep 01 23:59:06 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:06 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:59:06 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:06 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.366s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 23:59:06 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 2G" returned: 0 in 0.656s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7963549b-ad08-46ea-ac3f-1f87a5a771be -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:06 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7963549b-ad08-46ea-ac3f-1f87a5a771be -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 Sep 01 23:59:06 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:07 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7963549b-ad08-46ea-ac3f-1f87a5a771be -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382" returned: 0 in 0.351s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:07 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 is being set with open permissions: ugo+rw Sep 01 23:59:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:07 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 Sep 01 23:59:07 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:07 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382" returned: 0 in 0.307s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:07 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.info Sep 01 23:59:07 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:08 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.info" returned: 0 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:08 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.info is being set with open permissions: ugo+rw Sep 01 23:59:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:08 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.info Sep 01 23:59:08 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:08 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.info" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8245898a-f6d7-43af-8199-6dd8bfb1451e tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Create snapshot completed successfully Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Acquiring lock "cinder-7c6d3833-d45b-455c-bc9b-79c5df620382-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-7c6d3833-d45b-455c-bc9b-79c5df620382-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Acquiring lock "cinder-quobyte-7963549b-ad08-46ea-ac3f-1f87a5a771be" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Flow 'volume_create_manager' (f21f55ac-9aeb-4320-b2f9-982e8a854c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb9be68-fd4b-4a47-ad33-50f7862749b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-quobyte-7963549b-ad08-46ea-ac3f-1f87a5a771be" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Acquiring lock "cinder-quobyte-7c6d3833-d45b-455c-bc9b-79c5df620382" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb9be68-fd4b-4a47-ad33-50f7862749b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1506628092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b4a0c0-9297-4e35-abda-629786405907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d466cf6dd757473bae715fcd179e51a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:59:09Z,use_quota=True,user_id='99bf167df5b3404a813b9b7602624209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eec4863-f165-4552-ac58-58e25b76cd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eec4863-f165-4552-ac58-58e25b76cd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4462388e-d2aa-4736-91ad-aa140b46766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4462388e-d2aa-4736-91ad-aa140b46766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b4a0c0-9297-4e35-abda-629786405907', 'volume_name': 'volume-19b4a0c0-9297-4e35-abda-629786405907', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86cfc3-d2c8-450a-bf47-a097029d35d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86cfc3-d2c8-450a-bf47-a097029d35d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b715736-01bc-4654-b8c5-5642066c8a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Volume 19b4a0c0-9297-4e35-abda-629786405907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b4a0c0-9297-4e35-abda-629786405907', 'volume_size': 1} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1506628092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b4a0c0-9297-4e35-abda-629786405907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d466cf6dd757473bae715fcd179e51a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:59:09Z,use_quota=True,user_id='99bf167df5b3404a813b9b7602624209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Creating volume 19b4a0c0-9297-4e35-abda-629786405907 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:59:09 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-quobyte-7c6d3833-d45b-455c-bc9b-79c5df620382" acquired by "_delete_snapshot" :: waited 0.106s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:09 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907 1073741824 Sep 01 23:59:09 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Deleting offline snapshot 7c6d3833-d45b-455c-bc9b-79c5df620382 of volume 7963549b-ad08-46ea-ac3f-1f87a5a771be {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] snapshot_file for this snap is: volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d6911e-5104-4047-9c89-f4c84c23a622]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:59:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:09 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 Sep 01 23:59:09 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:10 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7963549b-ad08-46ea-ac3f-1f87a5a771be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[032adc75-ece4-4c14-8086-cb2c8fcd4029]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:10 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907 1073741824" returned: 0 in 0.824s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:10 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907 Sep 01 23:59:10 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:10 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be Sep 01 23:59:10 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:10 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907" returned: 0 in 0.392s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:10 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:10 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 Sep 01 23:59:10 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b715736-01bc-4654-b8c5-5642066c8a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b4a0c0-9297-4e35-abda-629786405907', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76f99ea-88de-4eb0-b879-d8d37cd88c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Volume volume-19b4a0c0-9297-4e35-abda-629786405907 (19b4a0c0-9297-4e35-abda-629786405907): created successfully Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76f99ea-88de-4eb0-b879-d8d37cd88c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Flow 'volume_create_manager' (f21f55ac-9aeb-4320-b2f9-982e8a854c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:59:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-60370ebe-15a9-4a35-b01f-a3379b8880e2 tempest-AttachVolumeShelveTestJSON-1798755473 None] Created volume successfully. Sep 01 23:59:11 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382" returned: 0 in 0.954s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:11 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382 Sep 01 23:59:11 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:12 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be.7c6d3833-d45b-455c-bc9b-79c5df620382" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-quobyte-7c6d3833-d45b-455c-bc9b-79c5df620382" released by "_delete_snapshot" :: held 2.754s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-quobyte-7963549b-ad08-46ea-ac3f-1f87a5a771be" released by "delete_snapshot" :: held 2.876s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Created reservations ['1990b3e2-b0fd-47f9-8f82-b7f9c586f0d3', '68dcab87-86b8-49ed-9cf1-d4205546349d', '9ff20551-7d50-4676-8e76-ef0ada83969a', '6feefeb7-d7da-4d4d-a5ca-1fe0812aebe3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:59:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Delete snapshot completed successfully. Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9a087061-2f5a-4541-8a8f-926bfc8fc234 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-7c6d3833-d45b-455c-bc9b-79c5df620382-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Acquiring lock "cinder-7963549b-ad08-46ea-ac3f-1f87a5a771be-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-7963549b-ad08-46ea-ac3f-1f87a5a771be-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Acquiring lock "cinder-quobyte-7963549b-ad08-46ea-ac3f-1f87a5a771be" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-quobyte-7963549b-ad08-46ea-ac3f-1f87a5a771be" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3f920b-2084-4f72-9fda-8b9e248d193d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 23:59:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:13 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be Sep 01 23:59:13 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:13 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be" returned: 0 in 0.812s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:13 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be Sep 01 23:59:13 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:14 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7963549b-ad08-46ea-ac3f-1f87a5a771be" returned: 0 in 0.380s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-quobyte-7963549b-ad08-46ea-ac3f-1f87a5a771be" released by "delete_volume" :: held 1.314s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Created reservations ['363314b5-3704-453d-9174-dac64ecca6ee', '52297a9b-14b5-4887-bcab-a50d7e9c4c44', '32447f0e-0c20-4e44-8af8-341cef24b09c', 'c1a64d7f-3cbe-4f7c-8b0e-451270cd0916'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:14 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 01 23:59:14 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:14 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 23:59:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Deleted volume successfully. Sep 01 23:59:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6793d043-91ad-4dc9-9695-f301207ff1b2 tempest-VolumesSnapshotNegativeTestJSON-321241678 None] Lock "cinder-7963549b-ad08-46ea-ac3f-1f87a5a771be-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Flow 'volume_create_manager' (14c4e121-f6df-4f8b-b54e-0a6f0d3eece4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1626a950-3c1d-4e3a-9459-af10277e5b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1626a950-3c1d-4e3a-9459-af10277e5b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-231078353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07947371-f0a2-480c-9b8e-819bda7f8365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e081826ddf41b299e0a456a17bdd57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:59:22Z,use_quota=True,user_id='c9541d1d15dd4c36879ff26869124831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafaf1c9-739d-469a-b977-f2843b737700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafaf1c9-739d-469a-b977-f2843b737700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8d5715-78e8-4d42-ab92-306571a786c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8d5715-78e8-4d42-ab92-306571a786c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07947371-f0a2-480c-9b8e-819bda7f8365', 'volume_name': 'volume-07947371-f0a2-480c-9b8e-819bda7f8365', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f2c204-8dea-4d90-b9c9-a77f17b0975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f2c204-8dea-4d90-b9c9-a77f17b0975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e520089-4826-44f1-ab10-115b51ea1039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:22 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Volume 07947371-f0a2-480c-9b8e-819bda7f8365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07947371-f0a2-480c-9b8e-819bda7f8365', 'volume_size': 1} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T21:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-231078353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07947371-f0a2-480c-9b8e-819bda7f8365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e081826ddf41b299e0a456a17bdd57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T21:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T21:59:22Z,use_quota=True,user_id='c9541d1d15dd4c36879ff26869124831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Creating volume 07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 23:59:22 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 01 23:59:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:22 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 1073741824 Sep 01 23:59:22 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:23 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 1073741824" returned: 0 in 0.736s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 23:59:23 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 Sep 01 23:59:23 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 23:59:23 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 01 23:59:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365" returned: 0 in 0.430s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 23:59:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 23:59:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 23:59:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e520089-4826-44f1-ab10-115b51ea1039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07947371-f0a2-480c-9b8e-819bda7f8365', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984af57f-c4a4-48bd-88cf-f570e11a3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 23:59:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Volume volume-07947371-f0a2-480c-9b8e-819bda7f8365 (07947371-f0a2-480c-9b8e-819bda7f8365): created successfully Sep 01 23:59:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984af57f-c4a4-48bd-88cf-f570e11a3849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 23:59:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Flow 'volume_create_manager' (14c4e121-f6df-4f8b-b54e-0a6f0d3eece4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 23:59:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a66587ff-c854-46ad-8458-46b3f0a115a6 tempest-VolumesActionsTest-2121102159 None] Created volume successfully. Sep 01 23:59:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-9b4a7d18-156f-4367-8d65-da9f09dbc74a req-5596bfb2-96f6-4786-b403-ff882aaf39ca tempest-AttachVolumeShelveTestJSON-1798755473 None] No connector for attachment 7716bfad-7c7f-4883-a4e4-3d8dee743f32; skipping storage backend terminate_connection call. {{(pid=86591) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 23:59:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-9b4a7d18-156f-4367-8d65-da9f09dbc74a req-5596bfb2-96f6-4786-b403-ff882aaf39ca tempest-AttachVolumeShelveTestJSON-1798755473 None] Deleting attachment 7716bfad-7c7f-4883-a4e4-3d8dee743f32. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 23:59:34 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=62,cinder:UPDATE=65,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:59:36 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:DELETE=6,cinder:SELECT=63,cinder:UPDATE=82,cinder:INSERT=18 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:59:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0fff6a15-1caa-45cf-994b-ff1b3f9c2607 tempest-VolumesActionsTest-2121102159 None] Acquiring lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365" by "attach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0fff6a15-1caa-45cf-994b-ff1b3f9c2607 tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365" acquired by "attach_volume" :: waited 0.075s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0fff6a15-1caa-45cf-994b-ff1b3f9c2607 tempest-VolumesActionsTest-2121102159 None] Attaching volume 07947371-f0a2-480c-9b8e-819bda7f8365 to instance 01733f28-9d22-43ae-9b03-a4bb67dd98b5 at mountpoint /dev/vdb on host None. Sep 01 23:59:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0fff6a15-1caa-45cf-994b-ff1b3f9c2607 tempest-VolumesActionsTest-2121102159 None] Attach volume completed successfully. Sep 01 23:59:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0fff6a15-1caa-45cf-994b-ff1b3f9c2607 tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365" released by "attach_volume" :: held 0.273s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e4ef8886-cea3-4d23-a335-9fdc056be9b4 tempest-VolumesActionsTest-2121102159 None] Acquiring lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365-detach_volume" by "detach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e4ef8886-cea3-4d23-a335-9fdc056be9b4 tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e4ef8886-cea3-4d23-a335-9fdc056be9b4 tempest-VolumesActionsTest-2121102159 None] Detaching volume 07947371-f0a2-480c-9b8e-819bda7f8365 from instance 01733f28-9d22-43ae-9b03-a4bb67dd98b5. Sep 01 23:59:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e4ef8886-cea3-4d23-a335-9fdc056be9b4 tempest-VolumesActionsTest-2121102159 None] Detach volume completed successfully. Sep 01 23:59:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e4ef8886-cea3-4d23-a335-9fdc056be9b4 tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:48 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:59:48 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:INSERT=2,cinder:SELECT=4,cinder:UPDATE=5 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 23:59:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-86b3d4d0-19b1-47ab-80c8-916af6468a6c tempest-VolumesActionsTest-2121102159 None] Acquiring lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365" by "attach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-86b3d4d0-19b1-47ab-80c8-916af6468a6c tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365" acquired by "attach_volume" :: waited 0.058s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-86b3d4d0-19b1-47ab-80c8-916af6468a6c tempest-VolumesActionsTest-2121102159 None] Attaching volume 07947371-f0a2-480c-9b8e-819bda7f8365 to instance 574f264e-cb4a-4224-a8b7-c2c954aa80ed at mountpoint /dev/vdb on host None. Sep 01 23:59:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-86b3d4d0-19b1-47ab-80c8-916af6468a6c tempest-VolumesActionsTest-2121102159 None] Attach volume completed successfully. Sep 01 23:59:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-86b3d4d0-19b1-47ab-80c8-916af6468a6c tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365" released by "attach_volume" :: held 0.151s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 23:59:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-abae675c-dbad-4917-a160-ba0de63b7014 tempest-VolumesActionsTest-2121102159 None] Acquiring lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365-detach_volume" by "detach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 23:59:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-abae675c-dbad-4917-a160-ba0de63b7014 tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 23:59:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-abae675c-dbad-4917-a160-ba0de63b7014 tempest-VolumesActionsTest-2121102159 None] Detaching volume 07947371-f0a2-480c-9b8e-819bda7f8365 from instance 574f264e-cb4a-4224-a8b7-c2c954aa80ed. Sep 01 23:59:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-abae675c-dbad-4917-a160-ba0de63b7014 tempest-VolumesActionsTest-2121102159 None] Detach volume completed successfully. Sep 01 23:59:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-abae675c-dbad-4917-a160-ba0de63b7014 tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Flow 'volume_create_manager' (4ccd885a-c1f3-478b-8dae-1c4abf67bd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c9917a-026a-4b3a-b2e4-2c12aad67ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c9917a-026a-4b3a-b2e4-2c12aad67ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1458913856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24617a4-fbaf-491d-8ae7-7882cafc7a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98971c7cb03459485a94ae0fba5c501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:00:00Z,use_quota=True,user_id='5d5b239a380d454b92d19e848129c968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67ae37c-777d-49c8-9074-c28de5130042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67ae37c-777d-49c8-9074-c28de5130042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb93e7eb-3800-40ad-9518-1a9f3b1a7846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb93e7eb-3800-40ad-9518-1a9f3b1a7846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e24617a4-fbaf-491d-8ae7-7882cafc7a57', 'volume_name': 'volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6144fd2c-3057-4b9d-8cae-c778d98b5d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6144fd2c-3057-4b9d-8cae-c778d98b5d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63833aa-11d2-4a74-aab2-0fcebd69d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Volume e24617a4-fbaf-491d-8ae7-7882cafc7a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57', 'volume_size': 1} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1458913856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24617a4-fbaf-491d-8ae7-7882cafc7a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98971c7cb03459485a94ae0fba5c501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:00:00Z,use_quota=True,user_id='5d5b239a380d454b92d19e848129c968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Creating volume e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:00:00 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:00:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:00 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 1073741824 Sep 02 00:00:00 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:01 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 1073741824" returned: 0 in 0.547s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:01 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 Sep 02 00:00:01 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:01 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:00:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63833aa-11d2-4a74-aab2-0fcebd69d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8499bc67-856e-4aa8-aa9b-ba9b976ac44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Volume volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 (e24617a4-fbaf-491d-8ae7-7882cafc7a57): created successfully Sep 02 00:00:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8499bc67-856e-4aa8-aa9b-ba9b976ac44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Flow 'volume_create_manager' (4ccd885a-c1f3-478b-8dae-1c4abf67bd65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:00:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b930ee1d-914e-45ec-b4bf-35c9d123b03c tempest-TestStampPattern-499105813 None] Created volume successfully. Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:06 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:00:06 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:06 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.398s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a11cf1-f0e1-4682-aee2-d52f08eadd1c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:07 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 Sep 02 00:00:07 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:07 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5659e163-ab2a-4c13-916c-965340b83b22]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:07 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 Sep 02 00:00:07 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:08 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365" returned: 0 in 0.669s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.c0394596-de69-4401-8ed8-c80a14bbe486vi8arsfl.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:08 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.c0394596-de69-4401-8ed8-c80a14bbe486vi8arsfl.img Sep 02 00:00:08 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:11 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=11,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:00:16 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:INSERT=3,cinder:SELECT=7,cinder:UPDATE=4 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:00:18 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.c0394596-de69-4401-8ed8-c80a14bbe486vi8arsfl.img" returned: 0 in 10.650s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e09ec70-bc41-4453-be70-2b56c448d8b5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:18 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 Sep 02 00:00:18 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:19 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365" returned: 0 in 0.638s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:19 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365, size 1024.00 MB, duration 10.65 sec, destination /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.c0394596-de69-4401-8ed8-c80a14bbe486vi8arsfl.img {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:00:19 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Converted 1024.00 MB image at 96.13 MB/s Sep 02 00:00:19 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] c0394596-de69-4401-8ed8-c80a14bbe486 was raw, no need to convert to raw {{(pid=86591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 02 00:00:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Acquiring lock "cinder-19b4a0c0-9297-4e35-abda-629786405907-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:00:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "cinder-19b4a0c0-9297-4e35-abda-629786405907-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:00:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Acquiring lock "cinder-quobyte-19b4a0c0-9297-4e35-abda-629786405907" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:00:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "cinder-quobyte-19b4a0c0-9297-4e35-abda-629786405907" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:00:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e73257-fbaa-486c-9a7f-741945290a50]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:21 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907 Sep 02 00:00:21 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:21 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907" returned: 0 in 0.639s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:21 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907 Sep 02 00:00:21 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:22 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-19b4a0c0-9297-4e35-abda-629786405907" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "cinder-quobyte-19b4a0c0-9297-4e35-abda-629786405907" released by "delete_volume" :: held 1.066s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:00:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Created reservations ['d5429151-b507-46cb-baf6-238d4cb117b1', 'cd4802b1-ef05-4050-959b-ee1a188fc393', '5554da73-a3c2-454f-8c55-be128d22d475', '233d9296-b6dd-4374-9d4a-fadbc40f6fbe'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:00:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:00:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:00:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:22 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:00:22 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:23 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:23 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:00:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Deleted volume successfully. Sep 02 00:00:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e10da511-79f5-4985-8f8d-70955c4b94b0 tempest-AttachVolumeShelveTestJSON-1798755473 None] Lock "cinder-19b4a0c0-9297-4e35-abda-629786405907-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Flow 'volume_create_manager' (f38ac4b7-1884-4e5b-8fb8-0d3b9e95be3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04f8ddb-8fdb-4c50-aeac-404ec2c85bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04f8ddb-8fdb-4c50-aeac-404ec2c85bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1198282371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eee738-6543-4d2e-a9dc-01740ca32668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea39baa2f294924bca2f2a248c3480c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:00:29Z,use_quota=True,user_id='d556b79964c94178a54f7e3e0b75d451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696f4a2e-f5a7-4276-84d1-0f3c709fd6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696f4a2e-f5a7-4276-84d1-0f3c709fd6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3aca762-f00b-406a-b47f-b9c3163d885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3aca762-f00b-406a-b47f-b9c3163d885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8eee738-6543-4d2e-a9dc-01740ca32668', 'volume_name': 'volume-d8eee738-6543-4d2e-a9dc-01740ca32668', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b83f62-855f-436a-aad6-ad6326550ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b83f62-855f-436a-aad6-ad6326550ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b81453-71fa-4419-bfc3-e62ea6bb3cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:29 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Volume d8eee738-6543-4d2e-a9dc-01740ca32668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8eee738-6543-4d2e-a9dc-01740ca32668', 'volume_size': 1} Sep 02 00:00:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-fe823df3-3ba9-47fb-ba31-3df5cf5b1717 req-5a12a925-3555-47a4-ad5e-32fd270ea663 tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.263s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Uploaded volume to glance image-id: c0394596-de69-4401-8ed8-c80a14bbe486. {{(pid=86591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.971s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1198282371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eee738-6543-4d2e-a9dc-01740ca32668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea39baa2f294924bca2f2a248c3480c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:00:29Z,use_quota=True,user_id='d556b79964c94178a54f7e3e0b75d451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Creating volume d8eee738-6543-4d2e-a9dc-01740ca32668 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:00:44 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c425c53d-640b-4051-b44d-6ef3390b3077 tempest-VolumesActionsTest-2121102159 None] Copy volume to image completed successfully. Sep 02 00:00:44 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668 1073741824 Sep 02 00:00:44 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:44 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668 1073741824" returned: 0 in 0.540s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:44 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668 Sep 02 00:00:44 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:45 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-fe823df3-3ba9-47fb-ba31-3df5cf5b1717 req-5a12a925-3555-47a4-ad5e-32fd270ea663 tempest-TestStampPattern-499105813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.636s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b81453-71fa-4419-bfc3-e62ea6bb3cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8eee738-6543-4d2e-a9dc-01740ca32668', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614a25c5-5ed3-433f-9d63-a80a9beababa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-fe823df3-3ba9-47fb-ba31-3df5cf5b1717 req-5a12a925-3555-47a4-ad5e-32fd270ea663 tempest-TestStampPattern-499105813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:45 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Volume volume-d8eee738-6543-4d2e-a9dc-01740ca32668 (d8eee738-6543-4d2e-a9dc-01740ca32668): created successfully Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614a25c5-5ed3-433f-9d63-a80a9beababa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Flow 'volume_create_manager' (f38ac4b7-1884-4e5b-8fb8-0d3b9e95be3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:00:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0113b4f6-ef42-421e-b318-4c2fc5567025 tempest-AttachVolumeTestJSON-1975745419 None] Created volume successfully. Sep 02 00:00:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-fe823df3-3ba9-47fb-ba31-3df5cf5b1717 req-5a12a925-3555-47a4-ad5e-32fd270ea663 tempest-TestStampPattern-499105813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3deb049-edd7-4631-bc5e-9fda6a703c2b', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:00:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-fe823df3-3ba9-47fb-ba31-3df5cf5b1717 req-5a12a925-3555-47a4-ad5e-32fd270ea663 tempest-TestStampPattern-499105813 None] attachment_update completed successfully. Sep 02 00:00:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ed7dd5-1f13-44a0-96d1-2eedf17a553e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:46 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 Sep 02 00:00:46 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-603c5f45-e320-48aa-b430-eb6ba994f77b req-d62cb184-8c0c-4d6b-a4df-dce7c4cb7576 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:46 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365" returned: 0 in 0.597s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[23172ede-0f32-47b9-9e06-eea6f9278a33]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:46 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 Sep 02 00:00:46 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:47 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:47 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img Sep 02 00:00:47 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-4281a4ab-0eae-421b-bcae-f702ad06770e req-7176f4f0-61a3-4f6e-a7e3-c9a228a82cef tempest-TestStampPattern-499105813 None] Terminate volume connection completed successfully. Sep 02 00:00:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4281a4ab-0eae-421b-bcae-f702ad06770e req-7176f4f0-61a3-4f6e-a7e3-c9a228a82cef tempest-TestStampPattern-499105813 None] Deleting attachment f3deb049-edd7-4631-bc5e-9fda6a703c2b. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:00:52 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img" returned: 0 in 5.717s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e045366-f52f-4b02-8c47-bcf348f0cd34]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:53 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 Sep 02 00:00:53 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:53 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365" returned: 0 in 0.670s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:53 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:00:53 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Converted 1024.00 MB image at 179.09 MB/s Sep 02 00:00:53 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] 2d9e644b-e172-4803-827a-0ca5de79e876 was raw, converting to qcow2 {{(pid=86591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 02 00:00:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcded9c-36a9-415b-af1e-794ed4a86cee]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:53 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img Sep 02 00:00:53 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:53 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img" returned: 0 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:54 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img Sep 02 00:00:54 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:54 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img" returned: 1 in 0.438s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:00:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img /opt/stack/data/cinder/conversion/vol_upload_nltugy79 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:54 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img /opt/stack/data/cinder/conversion/vol_upload_nltugy79 Sep 02 00:00:54 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:00:54 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img /opt/stack/data/cinder/conversion/vol_upload_nltugy79" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:54 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Image conversion details: src /opt/stack/data/cinder/conversion/07947371-f0a2-480c-9b8e-819bda7f8365.temp_image.2d9e644b-e172-4803-827a-0ca5de79e876eeasn2bc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nltugy79 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:00:54 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 02 00:00:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9fbfd1-062e-4b65-8b17-7780b9d97814]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nltugy79 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:54 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nltugy79 Sep 02 00:00:54 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:55 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nltugy79" returned: 0 in 0.340s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.323s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Uploaded volume to glance image-id: 2d9e644b-e172-4803-827a-0ca5de79e876. {{(pid=86591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 00:00:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-603c5f45-e320-48aa-b430-eb6ba994f77b req-d62cb184-8c0c-4d6b-a4df-dce7c4cb7576 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.748s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-603c5f45-e320-48aa-b430-eb6ba994f77b req-d62cb184-8c0c-4d6b-a4df-dce7c4cb7576 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:00:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.884s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:00:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c96ff8f9-bdbe-46c1-b9a1-e24a1336d509 tempest-VolumesActionsTest-2121102159 None] Copy volume to image completed successfully. Sep 02 00:00:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Creating offline snapshot c7fce037-72b0-489f-b2a6-6787d7b4123f of volume e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:00:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-603c5f45-e320-48aa-b430-eb6ba994f77b req-d62cb184-8c0c-4d6b-a4df-dce7c4cb7576 tempest-AttachVolumeTestJSON-1975745419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-d8eee738-6543-4d2e-a9dc-01740ca32668', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72646eed-c1bb-4a13-8c5c-059612a231d2', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:00:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4f84cf-68f7-43ec-8d68-8f792b938240]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-603c5f45-e320-48aa-b430-eb6ba994f77b req-d62cb184-8c0c-4d6b-a4df-dce7c4cb7576 tempest-AttachVolumeTestJSON-1975745419 None] attachment_update completed successfully. Sep 02 00:00:57 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 Sep 02 00:00:57 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:58 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57" returned: 0 in 0.720s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:58 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f 1G Sep 02 00:00:58 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:59 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f 1G" returned: 0 in 0.963s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:59 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f Sep 02 00:00:59 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Acquiring lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Acquiring lock "cinder-quobyte-07947371-f0a2-480c-9b8e-819bda7f8365" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Lock "cinder-quobyte-07947371-f0a2-480c-9b8e-819bda7f8365" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ef1380-fac9-44fe-b968-6f5a42c239bc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:59 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 Sep 02 00:00:59 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:00:59 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f" returned: 0 in 0.602s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:00:59 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f is being set with open permissions: ugo+rw Sep 02 00:00:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:00:59 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f Sep 02 00:00:59 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:00 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365" returned: 0 in 0.628s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:00 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365 Sep 02 00:01:00 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:00 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f" returned: 0 in 0.725s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:00 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.info Sep 02 00:01:00 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:00 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-07947371-f0a2-480c-9b8e-819bda7f8365" returned: 0 in 0.630s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Lock "cinder-quobyte-07947371-f0a2-480c-9b8e-819bda7f8365" released by "delete_volume" :: held 1.337s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Created reservations ['efd16b6e-554a-44a8-8533-9c4b312dbaae', '9063cad8-980c-4298-8552-a4bb92b7b969', '136293b8-b71a-49cf-ba1a-a15e8d0e2449', 'e9f75a6d-fd02-4439-b497-4ac4fe28ad98'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:01 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.info" returned: 0 in 0.588s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:01 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.info is being set with open permissions: ugo+rw Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:01 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.info Sep 02 00:01:01 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:01 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:01 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:01 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.info" returned: 0 in 0.515s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.438s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1cda12d6-d367-4e16-b1fa-aca3276e5e2a tempest-TestStampPattern-499105813 None] Create snapshot completed successfully Sep 02 00:01:01 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.634s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Deleted volume successfully. Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc1d9261-af2c-441f-9542-d50825b4355e tempest-VolumesActionsTest-2121102159 None] Lock "cinder-07947371-f0a2-480c-9b8e-819bda7f8365-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Flow 'volume_create_manager' (056980d9-22fe-432a-89a6-5a3894a3a1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c58fe2b-622a-4633-9aec-c4af7f190206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c58fe2b-622a-4633-9aec-c4af7f190206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2040899008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d819850-bba8-4a18-8139-07ca95ac3718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea39baa2f294924bca2f2a248c3480c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:02Z,use_quota=True,user_id='d556b79964c94178a54f7e3e0b75d451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803991a1-935c-4bfd-8ea4-d9c14f9efc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803991a1-935c-4bfd-8ea4-d9c14f9efc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6bc880-0155-4610-b19a-7cc238658513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6bc880-0155-4610-b19a-7cc238658513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d819850-bba8-4a18-8139-07ca95ac3718', 'volume_name': 'volume-7d819850-bba8-4a18-8139-07ca95ac3718', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e574cd-7889-4a92-979e-70ee09211402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e574cd-7889-4a92-979e-70ee09211402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dae0725-9637-4ab3-8c88-1b0e71a28cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:02 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Volume 7d819850-bba8-4a18-8139-07ca95ac3718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d819850-bba8-4a18-8139-07ca95ac3718', 'volume_size': 1} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2040899008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d819850-bba8-4a18-8139-07ca95ac3718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea39baa2f294924bca2f2a248c3480c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:02Z,use_quota=True,user_id='d556b79964c94178a54f7e3e0b75d451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Creating volume 7d819850-bba8-4a18-8139-07ca95ac3718 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:01:02 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:01:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:02 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718 1073741824 Sep 02 00:01:02 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:03 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718 1073741824" returned: 0 in 0.810s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:03 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718 Sep 02 00:01:03 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:03 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718" returned: 0 in 0.458s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:01:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dae0725-9637-4ab3-8c88-1b0e71a28cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d819850-bba8-4a18-8139-07ca95ac3718', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4299b0d0-40ae-417d-b046-372dd5f8b105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Volume volume-7d819850-bba8-4a18-8139-07ca95ac3718 (7d819850-bba8-4a18-8139-07ca95ac3718): created successfully Sep 02 00:01:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4299b0d0-40ae-417d-b046-372dd5f8b105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Flow 'volume_create_manager' (056980d9-22fe-432a-89a6-5a3894a3a1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2d1f2f90-0cd7-4c19-81e8-6dbe8f2c99ac tempest-AttachVolumeTestJSON-1975745419 None] Created volume successfully. Sep 02 00:01:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-7ada650e-1be2-4ff4-a0aa-4802eebad62f req-75ba1bdd-cade-4cc8-8e72-7fe53ae6fee6 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-7ada650e-1be2-4ff4-a0aa-4802eebad62f req-75ba1bdd-cade-4cc8-8e72-7fe53ae6fee6 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-7ada650e-1be2-4ff4-a0aa-4802eebad62f req-75ba1bdd-cade-4cc8-8e72-7fe53ae6fee6 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-7ada650e-1be2-4ff4-a0aa-4802eebad62f req-75ba1bdd-cade-4cc8-8e72-7fe53ae6fee6 tempest-AttachVolumeTestJSON-1975745419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-7d819850-bba8-4a18-8139-07ca95ac3718', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84e2e93a-faae-4a27-82f9-7ea158fe496b', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:01:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-7ada650e-1be2-4ff4-a0aa-4802eebad62f req-75ba1bdd-cade-4cc8-8e72-7fe53ae6fee6 tempest-AttachVolumeTestJSON-1975745419 None] attachment_update completed successfully. Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:06 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:06 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:06 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.275s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:01:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:01:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-35625c48-da9c-4a76-8281-b1c3a91d1bff req-ca314854-90fd-4145-8b27-be958e1d834b tempest-AttachVolumeTestJSON-1975745419 None] Terminate volume connection completed successfully. Sep 02 00:01:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-35625c48-da9c-4a76-8281-b1c3a91d1bff req-ca314854-90fd-4145-8b27-be958e1d834b tempest-AttachVolumeTestJSON-1975745419 None] Deleting attachment 72646eed-c1bb-4a13-8c5c-059612a231d2. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:01:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-017d7980-1a3d-4336-abe0-d73e6db72c01 req-e34ad70d-fc5c-430a-9522-eb434973a865 tempest-AttachVolumeTestJSON-1975745419 None] Terminate volume connection completed successfully. Sep 02 00:01:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-017d7980-1a3d-4336-abe0-d73e6db72c01 req-e34ad70d-fc5c-430a-9522-eb434973a865 tempest-AttachVolumeTestJSON-1975745419 None] Deleting attachment 84e2e93a-faae-4a27-82f9-7ea158fe496b. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=28,cinder:SELECT=47,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (d7e606b3-45bd-422a-9f1a-22e07a98cae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e06801-57b7-4c47-8e3c-8968e6c138b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e06801-57b7-4c47-8e3c-8968e6c138b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2083208391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e29e529-d11f-40fc-9cfe-7db49be7038f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:12Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36eaa196-bc04-4055-aac5-25181fd6d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36eaa196-bc04-4055-aac5-25181fd6d42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cd35a6-6a15-4a4c-b0bd-62ca937c1903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cd35a6-6a15-4a4c-b0bd-62ca937c1903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e29e529-d11f-40fc-9cfe-7db49be7038f', 'volume_name': 'volume-0e29e529-d11f-40fc-9cfe-7db49be7038f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac5b8d9-f924-46d9-bdef-c61e8e996bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac5b8d9-f924-46d9-bdef-c61e8e996bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b5199f-b156-4a28-8019-c5a31df1c5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Volume 0e29e529-d11f-40fc-9cfe-7db49be7038f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e29e529-d11f-40fc-9cfe-7db49be7038f', 'volume_size': 1} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2083208391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e29e529-d11f-40fc-9cfe-7db49be7038f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:12Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Creating volume 0e29e529-d11f-40fc-9cfe-7db49be7038f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:01:12 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:12 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f 1073741824 Sep 02 00:01:12 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Flow 'volume_create_manager' (c53d6994-baab-4334-a28b-e7cc95f29578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49662b72-07a5-4bdb-9bfe-73c4841cc118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49662b72-07a5-4bdb-9bfe-73c4841cc118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1828742737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9403cb45-38e0-4b00-a66a-5cf14cf7fab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98971c7cb03459485a94ae0fba5c501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7fce037-72b0-489f-b2a6-6787d7b4123f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:12Z,use_quota=True,user_id='5d5b239a380d454b92d19e848129c968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd62f3d6-b9f2-4742-ad7e-1335a8f62132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd62f3d6-b9f2-4742-ad7e-1335a8f62132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f615bf11-23da-4f76-a379-5ce88957e784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f615bf11-23da-4f76-a379-5ce88957e784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9403cb45-38e0-4b00-a66a-5cf14cf7fab5', 'volume_name': 'volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5', 'volume_size': 1, 'snapshot_id': 'c7fce037-72b0-489f-b2a6-6787d7b4123f'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd97375f-c312-4b5b-89a6-232ca50d7b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd97375f-c312-4b5b-89a6-232ca50d7b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0289f3-8a81-48c5-8b56-1afb29b452f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Volume 9403cb45-38e0-4b00-a66a-5cf14cf7fab5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5', 'volume_size': 1, 'snapshot_id': 'c7fce037-72b0-489f-b2a6-6787d7b4123f'} Sep 02 00:01:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:13 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f 1073741824" returned: 0 in 0.644s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:13 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f Sep 02 00:01:13 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:13 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f" returned: 0 in 0.348s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.883s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Acquiring lock "cinder-quobyte-c7fce037-72b0-489f-b2a6-6787d7b4123f-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b5199f-b156-4a28-8019-c5a31df1c5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e29e529-d11f-40fc-9cfe-7db49be7038f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c3d70f-4965-4913-b4e4-99aa1f7734a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-c7fce037-72b0-489f-b2a6-6787d7b4123f-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Creating volume 9403cb45-38e0-4b00-a66a-5cf14cf7fab5 from snapshot c7fce037-72b0-489f-b2a6-6787d7b4123f {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Acquiring lock "cinder-quobyte-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:13 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Volume volume-0e29e529-d11f-40fc-9cfe-7db49be7038f (0e29e529-d11f-40fc-9cfe-7db49be7038f): created successfully Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c3d70f-4965-4913-b4e4-99aa1f7734a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (d7e606b3-45bd-422a-9f1a-22e07a98cae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] snapshot: c7fce037-72b0-489f-b2a6-6787d7b4123f, volume: 9403cb45-38e0-4b00-a66a-5cf14cf7fab5, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9c42f930-aa36-4498-90db-b796684d1b2c tempest-VolumesGetTest-1356324720 None] Created volume successfully. Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd8298e-dd4f-4165-a0d6-c0758a644257]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:13 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f Sep 02 00:01:13 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:14 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f" returned: 0 in 0.400s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:01:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60dbb80-c104-4b13-bcec-ae2b096de0e7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:14 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 Sep 02 00:01:14 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:14 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57" returned: 0 in 0.489s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:01:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:01:14 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:01:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:14 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 Sep 02 00:01:14 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (5b8b8702-136d-4a67-a54b-1fa7b77fd271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0fefac-3bad-495b-b33e-4aae03011e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0fefac-3bad-495b-b33e-4aae03011e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1169180878',display_name='tempest-VolumesGetTest-Volume-362748454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c06e0c-0990-469e-8cc1-2e49dd15e732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:15Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8e68fa-1929-4b1f-af52-6ddb30752de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8e68fa-1929-4b1f-af52-6ddb30752de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e5e59c-d709-46ee-af89-223eb4d993f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e5e59c-d709-46ee-af89-223eb4d993f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c06e0c-0990-469e-8cc1-2e49dd15e732', 'volume_name': 'volume-68c06e0c-0990-469e-8cc1-2e49dd15e732', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a3bfeb-38fc-4b63-a04f-3f83c9777961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a3bfeb-38fc-4b63-a04f-3f83c9777961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd5049e-ee9f-422b-b52b-30b11f7bc3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:15 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Volume 68c06e0c-0990-469e-8cc1-2e49dd15e732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c06e0c-0990-469e-8cc1-2e49dd15e732', 'volume_size': 1} Sep 02 00:01:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "cinder-7d819850-bba8-4a18-8139-07ca95ac3718-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-7d819850-bba8-4a18-8139-07ca95ac3718-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "cinder-quobyte-7d819850-bba8-4a18-8139-07ca95ac3718" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-quobyte-7d819850-bba8-4a18-8139-07ca95ac3718" acquired by "delete_volume" :: waited 0.064s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[98afcc69-739a-4cc0-bc69-244ef5c5be8b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:16 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718 Sep 02 00:01:16 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:17 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718" returned: 0 in 0.916s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:17 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718 Sep 02 00:01:17 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:18 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d819850-bba8-4a18-8139-07ca95ac3718" returned: 0 in 0.728s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-quobyte-7d819850-bba8-4a18-8139-07ca95ac3718" released by "delete_volume" :: held 1.778s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=51,cinder:UPDATE=36,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Created reservations ['acc2a1db-533a-4626-96ee-665d253f1e01', '9ab7093e-d2fa-4e9d-a7ba-274246cf23f1', 'ab5fdc99-8506-4d66-891a-7564f74cb5ac', '89883ac2-3c88-437d-8831-4ee62a3042a0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:18 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:18 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "cinder-d8eee738-6543-4d2e-a9dc-01740ca32668-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-d8eee738-6543-4d2e-a9dc-01740ca32668-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "cinder-quobyte-d8eee738-6543-4d2e-a9dc-01740ca32668" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-quobyte-d8eee738-6543-4d2e-a9dc-01740ca32668" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a94305-6522-4f63-a55a-e6980284341a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:19 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.648s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Deleted volume successfully. Sep 02 00:01:19 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668 Sep 02 00:01:19 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b4fdf5c-d9d5-4acf-8730-bd3822f07234 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-7d819850-bba8-4a18-8139-07ca95ac3718-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:20 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668" returned: 0 in 1.175s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:20 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668 Sep 02 00:01:20 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:21 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d8eee738-6543-4d2e-a9dc-01740ca32668" returned: 0 in 0.836s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-quobyte-d8eee738-6543-4d2e-a9dc-01740ca32668" released by "delete_volume" :: held 2.157s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Created reservations ['6ea097e3-781c-4c00-acb4-3304c7e39de9', '04d2474f-103d-4fe5-8bdc-96b956742713', 'd3317662-4835-4c03-a5be-5436147c2414', 'd3068353-34e9-4bee-9bda-0b12fb5a2493'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:21 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:21 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "cinder-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "cinder-quobyte-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:22 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-quobyte-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6" acquired by "delete_volume" :: waited 0.056s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 1.012s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:22 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f274d-91f9-4a00-8dcb-a02096e8ee56]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Deleted volume successfully. Sep 02 00:01:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54a9b06e-1a73-47a5-83bb-1c77acb46171 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-d8eee738-6543-4d2e-a9dc-01740ca32668-delete_volume" released by "delete_volume" :: held 3.982s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:23 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" returned: 0 in 8.299s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57, size 1024.00 MB, duration 8.30 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:01:23 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Converted 1024.00 MB image at 123.37 MB/s Sep 02 00:01:23 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 is being set with open permissions: ugo+rw Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:23 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 Sep 02 00:01:23 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:23 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 Sep 02 00:01:23 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:23 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" returned: 0 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" released by "_copy_volume_from_snapshot" :: held 9.618s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:23 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6" returned: 0 in 0.472s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:23 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6 Sep 02 00:01:23 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-c7fce037-72b0-489f-b2a6-6787d7b4123f-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" released by "_create_volume_from_snapshot" :: held 9.734s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.781s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.088s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1169180878',display_name='tempest-VolumesGetTest-Volume-362748454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c06e0c-0990-469e-8cc1-2e49dd15e732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:15Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Creating volume 68c06e0c-0990-469e-8cc1-2e49dd15e732 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:01:23 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:23 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 1073741824 Sep 02 00:01:23 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0289f3-8a81-48c5-8b56-1afb29b452f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5', 'volume_size': 1, 'snapshot_id': 'c7fce037-72b0-489f-b2a6-6787d7b4123f'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81da020a-7347-4f9b-a726-a4d6def2495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Volume volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 (9403cb45-38e0-4b00-a66a-5cf14cf7fab5): created successfully Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81da020a-7347-4f9b-a726-a4d6def2495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Flow 'volume_create_manager' (c53d6994-baab-4334-a28b-e7cc95f29578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5a857718-ceae-4368-b646-df95cae4eadc tempest-TestStampPattern-499105813 None] Created volume successfully. Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Flow 'volume_create_manager' (358b5c5f-6ce4-4d08-ba34-4fab414eb26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e736cce-2534-4713-82e0-380551601574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e736cce-2534-4713-82e0-380551601574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-635944203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12acd65-b288-4080-879e-20fe81329389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf1af1ef8774407bbd17d9341499e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:24Z,use_quota=True,user_id='162912728b4e499b81b5bfe82d5dfa79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbaa3aa-955e-4551-a10c-f42d2f42d73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbaa3aa-955e-4551-a10c-f42d2f42d73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696dd6f5-c2a7-40db-9d9c-2ff95fd6c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:23 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696dd6f5-c2a7-40db-9d9c-2ff95fd6c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e12acd65-b288-4080-879e-20fe81329389', 'volume_name': 'volume-e12acd65-b288-4080-879e-20fe81329389', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a75f14-3c2f-4ae7-8f08-6f20d3555866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a75f14-3c2f-4ae7-8f08-6f20d3555866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbfcbf3-be49-4870-a7ea-944bffd8ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Volume e12acd65-b288-4080-879e-20fe81329389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e12acd65-b288-4080-879e-20fe81329389', 'volume_size': 1} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6" returned: 0 in 0.567s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-quobyte-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6" released by "delete_volume" :: held 1.183s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Created reservations ['c3c154f5-e910-4c58-8cae-fa07ebe27f1a', '6c3e30db-62c4-4796-a9b0-d8ee27bc73d6', '74357faf-e60e-4462-9cfa-5221b52decf7', '70ae7ebc-f228-4bf8-8c5b-dcb92d6d4447'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:24 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 1073741824" returned: 0 in 0.847s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:24 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:24 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:24 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 Sep 02 00:01:24 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:24 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.420s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Deleted volume successfully. Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34785876-b895-4097-810f-c5b838871711 tempest-AttachVolumeTestJSON-1975745419 None] Lock "cinder-0e0bf9dd-7b70-4e1c-a63b-c23374ee89b6-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:24 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732" returned: 0 in 0.440s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-635944203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12acd65-b288-4080-879e-20fe81329389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf1af1ef8774407bbd17d9341499e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:24Z,use_quota=True,user_id='162912728b4e499b81b5bfe82d5dfa79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Creating volume e12acd65-b288-4080-879e-20fe81329389 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:01:24 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:24 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389 1073741824 Sep 02 00:01:24 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd5049e-ee9f-422b-b52b-30b11f7bc3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c06e0c-0990-469e-8cc1-2e49dd15e732', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc18845-f8e1-4f3c-991b-362dc7a29001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Volume volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 (68c06e0c-0990-469e-8cc1-2e49dd15e732): created successfully Sep 02 00:01:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc18845-f8e1-4f3c-991b-362dc7a29001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (5b8b8702-136d-4a67-a54b-1fa7b77fd271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c28a3526-6eda-49d0-b38a-17e63bd73953 tempest-VolumesGetTest-1356324720 None] Created volume successfully. Sep 02 00:01:25 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389 1073741824" returned: 0 in 0.647s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:25 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389 Sep 02 00:01:25 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:26 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389" returned: 0 in 0.502s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbfcbf3-be49-4870-a7ea-944bffd8ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12acd65-b288-4080-879e-20fe81329389', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20e7d14-0bdf-42cb-b830-4001f74ea8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Volume volume-e12acd65-b288-4080-879e-20fe81329389 (e12acd65-b288-4080-879e-20fe81329389): created successfully Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20e7d14-0bdf-42cb-b830-4001f74ea8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Flow 'volume_create_manager' (358b5c5f-6ce4-4d08-ba34-4fab414eb26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5dda0e8d-2023-4d34-920d-1b5f5d1109c9 tempest-AttachVolumeNegativeTest-328114835 None] Created volume successfully. Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-68c06e0c-0990-469e-8cc1-2e49dd15e732-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Lock "cinder-68c06e0c-0990-469e-8cc1-2e49dd15e732-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-quobyte-68c06e0c-0990-469e-8cc1-2e49dd15e732" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-68c06e0c-0990-469e-8cc1-2e49dd15e732" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[05837fe3-1089-4025-b08f-39c9b7c9617c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:26 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 Sep 02 00:01:26 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:27 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732" returned: 0 in 0.526s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:27 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732 Sep 02 00:01:27 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:27 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-68c06e0c-0990-469e-8cc1-2e49dd15e732" returned: 0 in 0.638s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-68c06e0c-0990-469e-8cc1-2e49dd15e732" released by "delete_volume" :: held 1.235s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Created reservations ['e25717a0-2572-477f-964e-0daae381f712', 'bdbcc439-b3eb-438c-97dc-13ba90b80963', '03fe277d-bbc5-48ee-a821-5f66118d7e53', 'c133ef72-c8de-46ca-bbf3-3c1cc7763443'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:28 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:28 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-306cf461-7481-4de7-b765-63f88c313849 req-1f8bf388-e2f8-4263-8da6-0d8615ed2d4a tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-306cf461-7481-4de7-b765-63f88c313849 req-1f8bf388-e2f8-4263-8da6-0d8615ed2d4a tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-306cf461-7481-4de7-b765-63f88c313849 req-1f8bf388-e2f8-4263-8da6-0d8615ed2d4a tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-306cf461-7481-4de7-b765-63f88c313849 req-1f8bf388-e2f8-4263-8da6-0d8615ed2d4a tempest-AttachVolumeNegativeTest-328114835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-e12acd65-b288-4080-879e-20fe81329389', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ad3383b-976e-469e-928e-bade64c4a518', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:01:28 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.520s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:28 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Deleted volume successfully. Sep 02 00:01:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cf18e53a-4417-4936-916f-8aa7ed8f748a tempest-VolumesGetTest-1356324720 None] Lock "cinder-68c06e0c-0990-469e-8cc1-2e49dd15e732-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-306cf461-7481-4de7-b765-63f88c313849 req-1f8bf388-e2f8-4263-8da6-0d8615ed2d4a tempest-AttachVolumeNegativeTest-328114835 None] attachment_update completed successfully. Sep 02 00:01:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-0e29e529-d11f-40fc-9cfe-7db49be7038f-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Lock "cinder-0e29e529-d11f-40fc-9cfe-7db49be7038f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-quobyte-0e29e529-d11f-40fc-9cfe-7db49be7038f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-0e29e529-d11f-40fc-9cfe-7db49be7038f" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bde2bf3-6be5-44d3-8b49-cb1f38febc11]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:29 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f Sep 02 00:01:29 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:29 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f" returned: 0 in 0.497s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:29 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f Sep 02 00:01:29 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:30 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0e29e529-d11f-40fc-9cfe-7db49be7038f" returned: 0 in 0.408s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-0e29e529-d11f-40fc-9cfe-7db49be7038f" released by "delete_volume" :: held 0.962s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Created reservations ['7c02ca20-d45d-47e2-b245-6a0e8cb39e02', '6c95e9b8-70ba-44f1-9f10-34d6372afee6', 'c1862ead-2dc5-447a-9c6f-f5a76257ee0e', 'dbfb0a6e-5269-4844-b41c-bc2e3fe55e5b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:30 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:30 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:30 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.485s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Deleted volume successfully. Sep 02 00:01:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0a999eb-847e-48d6-83bc-e79c6431cf44 tempest-VolumesGetTest-1356324720 None] Lock "cinder-0e29e529-d11f-40fc-9cfe-7db49be7038f-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (d8f90610-5d44-4ece-9774-58b73fe95457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074365da-ed06-409f-b549-2f630a60536b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074365da-ed06-409f-b549-2f630a60536b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-821568720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:32Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6438a83e-c82c-4c4e-851c-b76b5b84672f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6438a83e-c82c-4c4e-851c-b76b5b84672f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d38fbe-3a82-4925-898e-377d44036f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d38fbe-3a82-4925-898e-377d44036f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab', 'volume_name': 'volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5cd987-f5d4-49cd-83d2-ed5bccdaa014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5cd987-f5d4-49cd-83d2-ed5bccdaa014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80906337-b023-49db-b42c-ecc91b346cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:32 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Volume ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab', 'volume_size': 1} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-821568720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:32Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Creating volume ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:01:32 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:01:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:32 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab 1073741824 Sep 02 00:01:32 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:32 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab 1073741824" returned: 0 in 0.738s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:33 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab Sep 02 00:01:33 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:33 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:01:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80906337-b023-49db-b42c-ecc91b346cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde4f3ba-4eb2-4f3d-91e5-e7b5db0c92ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Volume volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab (ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab): created successfully Sep 02 00:01:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde4f3ba-4eb2-4f3d-91e5-e7b5db0c92ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (d8f90610-5d44-4ece-9774-58b73fe95457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e3125a71-c908-4188-8cef-70d3463dccf9 tempest-VolumesGetTest-1356324720 None] Created volume successfully. Sep 02 00:01:34 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (70737602-d5ca-4721-b221-13614c0aa453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd5d5e1-79d0-4ea0-ba1c-91c9a4c033b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd5d5e1-79d0-4ea0-ba1c-91c9a4c033b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-735258379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d917a03d-20c5-4079-8be5-c19ee5d7b5d1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:35Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267147b7-ca93-4584-b6de-b18a0277c5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267147b7-ca93-4584-b6de-b18a0277c5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1591763f-50fc-46b9-bb7b-17fd0b2987d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1591763f-50fc-46b9-bb7b-17fd0b2987d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd917a03d-20c5-4079-8be5-c19ee5d7b5d1', 'volume_name': 'volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1', 'volume_size': 1, 'source_volid': 'ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab', 'source_volstatus': 'available'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c759ee9-4bd2-427e-91d8-c1c8cb075a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c759ee9-4bd2-427e-91d8-c1c8cb075a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2525aec-b0a6-4fae-ad9e-4d939d53bc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Volume d917a03d-20c5-4079-8be5-c19ee5d7b5d1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1', 'volume_size': 1, 'source_volid': 'ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab', 'source_volstatus': 'available'} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:35 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Cloning volume ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab to volume d917a03d-20c5-4079-8be5-c19ee5d7b5d1 Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Creating offline snapshot 71f1cabb-5927-40cd-996f-4b6c2b2f824f of volume ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a3661d-bfc5-46e4-8889-bd5315f80e72]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:35 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab Sep 02 00:01:35 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:35 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab" returned: 0 in 0.587s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:35 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f 1G Sep 02 00:01:35 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:36 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f 1G" returned: 0 in 0.743s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:36 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f Sep 02 00:01:36 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:37 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f" returned: 0 in 0.574s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:37 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f is being set with open permissions: ugo+rw Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:37 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f Sep 02 00:01:37 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:37 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f" returned: 0 in 0.529s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Flow 'volume_create_manager' (6e27a0f3-4215-43e5-b559-1b854c7fbda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608147b4-bd45-4e0e-af7d-f1e534590bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608147b4-bd45-4e0e-af7d-f1e534590bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1292690901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39787dcf-2be0-4e93-8cb0-28b5adcf1673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fa62c7c3464116b5dce92c5f7a2a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:38Z,use_quota=True,user_id='6cd3443c350c43918ed6fd6045d199ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b8efaa-f10e-4e7f-8cc7-a28dd09142e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b8efaa-f10e-4e7f-8cc7-a28dd09142e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07471889-fe3f-4ee2-90d4-7e7d7128d3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07471889-fe3f-4ee2-90d4-7e7d7128d3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39787dcf-2be0-4e93-8cb0-28b5adcf1673', 'volume_name': 'volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7577c9b-87c6-49e8-88dc-9d4579672710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7577c9b-87c6-49e8-88dc-9d4579672710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e0056-8eb4-4323-8de7-bbff7140864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:37 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.info Sep 02 00:01:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Volume 39787dcf-2be0-4e93-8cb0-28b5adcf1673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673', 'volume_size': 1} Sep 02 00:01:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:37 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:38 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.info" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:38 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.info is being set with open permissions: ugo+rw Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:38 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.info Sep 02 00:01:38 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:38 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.info" returned: 0 in 0.334s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-quobyte-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] snapshot: 71f1cabb-5927-40cd-996f-4b6c2b2f824f, volume: d917a03d-20c5-4079-8be5-c19ee5d7b5d1, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1be93aa-b00e-43f4-9ba5-86f4f8cca505]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:38 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f Sep 02 00:01:38 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:39 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:01:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e36e7a-e956-4e48-806f-b8d6fa02061f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:39 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab Sep 02 00:01:39 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:39 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab" returned: 0 in 0.407s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:01:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:01:39 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:01:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:39 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 Sep 02 00:01:39 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:45 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" returned: 0 in 6.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:45 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:01:45 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Converted 1024.00 MB image at 161.26 MB/s Sep 02 00:01:45 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 is being set with open permissions: ugo+rw Sep 02 00:01:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:45 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 Sep 02 00:01:45 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:46 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" returned: 0 in 0.318s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" released by "_copy_volume_from_snapshot" :: held 7.625s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-quobyte-71f1cabb-5927-40cd-996f-4b6c2b2f824f" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-71f1cabb-5927-40cd-996f-4b6c2b2f824f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Deleting offline snapshot 71f1cabb-5927-40cd-996f-4b6c2b2f824f of volume ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] snapshot_file for this snap is: volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f11fb4b-4f42-434e-af77-7cfe5a0ab631]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:46 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f Sep 02 00:01:46 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:46 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d16846-7cf4-4c6e-bd39-d6bae6b8d57a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:46 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab Sep 02 00:01:46 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:47 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab" returned: 0 in 0.653s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:47 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f Sep 02 00:01:47 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:47 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=55,cinder:SELECT=43,cinder:INSERT=19,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:01:47 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f" returned: 0 in 0.470s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:47 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f Sep 02 00:01:47 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:48 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab.71f1cabb-5927-40cd-996f-4b6c2b2f824f" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-71f1cabb-5927-40cd-996f-4b6c2b2f824f" released by "_delete_snapshot" :: held 1.999s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.074s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.431s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1292690901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39787dcf-2be0-4e93-8cb0-28b5adcf1673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fa62c7c3464116b5dce92c5f7a2a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:38Z,use_quota=True,user_id='6cd3443c350c43918ed6fd6045d199ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Creating volume 39787dcf-2be0-4e93-8cb0-28b5adcf1673 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:01:48 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:48 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 1073741824 Sep 02 00:01:48 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2525aec-b0a6-4fae-ad9e-4d939d53bc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1', 'volume_size': 1, 'source_volid': 'ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab', 'source_volstatus': 'available'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8205e5-19cf-403c-a0f2-338ad0ab39f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Volume volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 (d917a03d-20c5-4079-8be5-c19ee5d7b5d1): created successfully Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8205e5-19cf-403c-a0f2-338ad0ab39f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (70737602-d5ca-4721-b221-13614c0aa453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7c5dab10-dbdd-4c17-a4c5-845a526414c9 tempest-VolumesGetTest-1356324720 None] Created volume successfully. Sep 02 00:01:48 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 1073741824" returned: 0 in 0.572s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:48 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 Sep 02 00:01:48 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:49 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e0056-8eb4-4323-8de7-bbff7140864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c76870-c411-4d90-aa96-d70e2495fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Volume volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 (39787dcf-2be0-4e93-8cb0-28b5adcf1673): created successfully Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c76870-c411-4d90-aa96-d70e2495fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Flow 'volume_create_manager' (6e27a0f3-4215-43e5-b559-1b854c7fbda8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-e5cfe7f7-8048-454f-9b5b-eb34da8c410c req-a7cd3dac-4888-4c5e-9ab8-ea48cdf0b570 tempest-VolumesSnapshotsTestJSON-1561196568 None] Created volume successfully. Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (d2bc4b9a-ce6f-45c6-ac4a-e25ca01b02b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05d2870-8948-44f9-b296-a64ba867fc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05d2870-8948-44f9-b296-a64ba867fc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-561441304',display_name='tempest-VolumesGetTest-Volume-1844588256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea05f656-a873-4e1c-8347-48d5bccde9dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:49Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aa47b8-de7b-4d32-9cd3-26854d139315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aa47b8-de7b-4d32-9cd3-26854d139315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c594caf-1906-4b92-a06d-69b435c1678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c594caf-1906-4b92-a06d-69b435c1678f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea05f656-a873-4e1c-8347-48d5bccde9dd', 'volume_name': 'volume-ea05f656-a873-4e1c-8347-48d5bccde9dd', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49b56aa-6eeb-4385-8362-e2240e54b19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49b56aa-6eeb-4385-8362-e2240e54b19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7520a807-7bee-4d1e-b8f0-9c4404e4faf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Volume ea05f656-a873-4e1c-8347-48d5bccde9dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea05f656-a873-4e1c-8347-48d5bccde9dd', 'volume_size': 1} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-561441304',display_name='tempest-VolumesGetTest-Volume-1844588256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea05f656-a873-4e1c-8347-48d5bccde9dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:49Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Creating volume ea05f656-a873-4e1c-8347-48d5bccde9dd {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:01:49 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:49 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd 1073741824 Sep 02 00:01:49 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:50 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd 1073741824" returned: 0 in 0.492s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:50 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd Sep 02 00:01:50 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:50 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.479s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7520a807-7bee-4d1e-b8f0-9c4404e4faf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea05f656-a873-4e1c-8347-48d5bccde9dd', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08bb8d6-e501-4bc8-93d5-01f793206a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Creating offline snapshot 0d17819f-e60e-4a07-8470-6710ac7f6ff6 of volume 39787dcf-2be0-4e93-8cb0-28b5adcf1673 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:01:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Volume volume-ea05f656-a873-4e1c-8347-48d5bccde9dd (ea05f656-a873-4e1c-8347-48d5bccde9dd): created successfully Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08bb8d6-e501-4bc8-93d5-01f793206a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (d2bc4b9a-ce6f-45c6-ac4a-e25ca01b02b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[786fcc98-684a-4c63-952b-1631eecadd22]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c1bb68af-403b-4b77-8def-d2ac3fc59d62 tempest-VolumesGetTest-1356324720 None] Created volume successfully. Sep 02 00:01:50 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 Sep 02 00:01:50 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:50 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673" returned: 0 in 0.487s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:50 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 1G Sep 02 00:01:50 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:51 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 1G" returned: 0 in 0.456s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:51 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 Sep 02 00:01:51 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:51 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:51 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 is being set with open permissions: ugo+rw Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:51 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 Sep 02 00:01:51 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-ea05f656-a873-4e1c-8347-48d5bccde9dd-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Lock "cinder-ea05f656-a873-4e1c-8347-48d5bccde9dd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-quobyte-ea05f656-a873-4e1c-8347-48d5bccde9dd" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-ea05f656-a873-4e1c-8347-48d5bccde9dd" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d3d370-a101-4b4a-bf4e-fd3e4642cd2c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:52 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd Sep 02 00:01:52 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:52 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:52 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.info Sep 02 00:01:52 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:52 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:52 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd Sep 02 00:01:52 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:52 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.info" returned: 0 in 0.294s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:52 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.info is being set with open permissions: ugo+rw Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:52 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.info Sep 02 00:01:52 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:52 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea05f656-a873-4e1c-8347-48d5bccde9dd" returned: 0 in 0.302s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-ea05f656-a873-4e1c-8347-48d5bccde9dd" released by "delete_volume" :: held 0.805s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:52 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.info" returned: 0 in 0.293s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-a0c30749-a8f1-49a4-a358-50582e36cb1e req-584641b0-b6ee-4e65-a4f0-e524429aa7d0 tempest-VolumesSnapshotsTestJSON-1561196568 None] Create snapshot completed successfully Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Created reservations ['fc165165-c684-4f90-8f64-47772a751e7c', 'aedb4bdb-2b05-41ec-b735-1d1c7491c05e', 'd6c200fc-e195-4e94-8b1f-eca6a0b9547b', '02ba6b8d-b5bf-4f99-b1f8-57d34dd89c92'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:52 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:52 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:53 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.245s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Deleted volume successfully. Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-d917a03d-20c5-4079-8be5-c19ee5d7b5d1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a914c58-be9c-4dbf-b1d2-6fe6c9ae1a3c tempest-VolumesGetTest-1356324720 None] Lock "cinder-ea05f656-a873-4e1c-8347-48d5bccde9dd-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Lock "cinder-d917a03d-20c5-4079-8be5-c19ee5d7b5d1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-quobyte-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fda23d-b51f-452e-9d22-328d67f71301]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Acquiring lock "cinder-0d17819f-e60e-4a07-8470-6710ac7f6ff6-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-0d17819f-e60e-4a07-8470-6710ac7f6ff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Acquiring lock "cinder-quobyte-39787dcf-2be0-4e93-8cb0-28b5adcf1673" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:53 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 Sep 02 00:01:53 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-quobyte-39787dcf-2be0-4e93-8cb0-28b5adcf1673" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Acquiring lock "cinder-quobyte-0d17819f-e60e-4a07-8470-6710ac7f6ff6" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-quobyte-0d17819f-e60e-4a07-8470-6710ac7f6ff6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Deleting offline snapshot 0d17819f-e60e-4a07-8470-6710ac7f6ff6 of volume 39787dcf-2be0-4e93-8cb0-28b5adcf1673 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] snapshot_file for this snap is: volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[600744ae-6d2a-425d-8df6-5756c30e9e6e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:53 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 Sep 02 00:01:53 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:53 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" returned: 0 in 0.484s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:53 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1 Sep 02 00:01:53 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:53 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db565f9b-0c86-4939-996a-4b0bef19ea2b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:54 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" returned: 0 in 0.311s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-d917a03d-20c5-4079-8be5-c19ee5d7b5d1" released by "delete_volume" :: held 0.848s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:54 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 Sep 02 00:01:54 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Created reservations ['a898e3f5-42d1-4817-944a-8670e5c0dcba', 'a5587372-3fef-4ec3-988e-def9e4a50524', 'fd29a643-2c77-406e-a6c4-7f38ac24e0ce', '83824553-5370-447a-b1e3-bb02b51a6adf'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:54 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:54 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Lock "cinder-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:54 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673" returned: 0 in 0.642s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-quobyte-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:54 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 Sep 02 00:01:54 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a15581-5421-4e6a-b73b-8f94edd7dc6f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:54 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.542s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Deleted volume successfully. Sep 02 00:01:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54ee3859-dcc3-44e6-95dc-51d699f23edf tempest-VolumesGetTest-1356324720 None] Lock "cinder-d917a03d-20c5-4079-8be5-c19ee5d7b5d1-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:54 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab Sep 02 00:01:54 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:55 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6" returned: 0 in 0.574s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:55 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6 Sep 02 00:01:55 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-88c2bfd7-6200-4a6c-8ce9-390b6241752f req-5855c00d-2605-4702-bd3f-383edba0a04f tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-88c2bfd7-6200-4a6c-8ce9-390b6241752f req-5855c00d-2605-4702-bd3f-383edba0a04f tempest-TestStampPattern-499105813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-88c2bfd7-6200-4a6c-8ce9-390b6241752f req-5855c00d-2605-4702-bd3f-383edba0a04f tempest-TestStampPattern-499105813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:55 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-88c2bfd7-6200-4a6c-8ce9-390b6241752f req-5855c00d-2605-4702-bd3f-383edba0a04f tempest-TestStampPattern-499105813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e289fa12-b9f1-48ec-85db-e4a651964992', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:01:55 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab Sep 02 00:01:55 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-88c2bfd7-6200-4a6c-8ce9-390b6241752f req-5855c00d-2605-4702-bd3f-383edba0a04f tempest-TestStampPattern-499105813 None] attachment_update completed successfully. Sep 02 00:01:55 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673.0d17819f-e60e-4a07-8470-6710ac7f6ff6" returned: 0 in 0.316s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-quobyte-0d17819f-e60e-4a07-8470-6710ac7f6ff6" released by "_delete_snapshot" :: held 2.142s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-quobyte-39787dcf-2be0-4e93-8cb0-28b5adcf1673" released by "delete_snapshot" :: held 2.175s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:55 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab" returned: 0 in 0.380s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG cinder.quota [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Created reservations ['b7bb8a91-9737-49a8-92a2-98c0039d9e7a', '75145ea4-7ede-4a03-b86e-9a6faf023750', '34afb9eb-7cdb-4c6e-a799-3d02e2e16287', '966bb966-1917-4073-b268-807c9da5d682'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab" released by "delete_volume" :: held 1.061s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Delete snapshot completed successfully. Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Created reservations ['2e49ab06-ba5e-4fbc-9690-b1160b8daefb', '39827274-7a92-43a1-820a-b3ed948a4f7a', '38069347-8948-4f48-ae37-20f1b83edca6', '3977e8a8-9771-469e-91d4-4cb498510197'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-1c9d34bc-98c1-446d-a3db-790690d5ed7d req-09ff3e29-79e2-4ec2-8df7-51b6f32c00b6 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-0d17819f-e60e-4a07-8470-6710ac7f6ff6-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:56 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:56 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:56 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.322s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Deleted volume successfully. Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f1b7bba8-b5f3-4cb5-8aa6-e20899c298fc tempest-VolumesGetTest-1356324720 None] Lock "cinder-ce49c765-4fdd-4d96-a0d2-5c2fb43d10ab-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Acquiring lock "cinder-39787dcf-2be0-4e93-8cb0-28b5adcf1673-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-39787dcf-2be0-4e93-8cb0-28b5adcf1673-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Acquiring lock "cinder-quobyte-39787dcf-2be0-4e93-8cb0-28b5adcf1673" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-quobyte-39787dcf-2be0-4e93-8cb0-28b5adcf1673" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[04af6a31-4c88-4470-b14f-0129226b8d09]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:57 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 Sep 02 00:01:57 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:57 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673" returned: 0 in 0.436s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:57 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673 Sep 02 00:01:57 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (b8e48b58-8631-466a-8984-1d53f175f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd65e50-3a2a-4cbd-9ab1-070919a93d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd65e50-3a2a-4cbd-9ab1-070919a93d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1909211045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bfdd11-2a0a-43f1-8528-4d93bd010e41,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:58Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2692987-bcdb-407b-a9a8-88941ea81667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2692987-bcdb-407b-a9a8-88941ea81667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4f4012-3446-4027-9375-cbe2d1851e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:01:57 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-39787dcf-2be0-4e93-8cb0-28b5adcf1673" returned: 0 in 0.303s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-quobyte-39787dcf-2be0-4e93-8cb0-28b5adcf1673" released by "delete_volume" :: held 0.832s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.quota [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Created reservations ['6c97cc4f-9feb-496b-a9b1-bf9f0be05520', '8a9c56b4-f3ea-423f-8000-a95bfabeb61d', '39026370-44d6-44f7-8ec3-7612f2355818', 'd152713e-efc6-45b3-94a6-bd8fafb4198f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:58 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:01:58 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4f4012-3446-4027-9375-cbe2d1851e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4bfdd11-2a0a-43f1-8528-4d93bd010e41', 'volume_name': 'volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c427bc2-0d09-4de3-8bbf-3849059220d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c427bc2-0d09-4de3-8bbf-3849059220d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7c24c7-5975-44ed-9112-f30908054a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:01:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Volume c4bfdd11-2a0a-43f1-8528-4d93bd010e41: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Trying to clone c4bfdd11-2a0a-43f1-8528-4d93bd010e41 from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:01:58 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.337s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG cinder.manager [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:01:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Deleted volume successfully. Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-90aede38-b37d-423f-af65-d6b6927a39da req-0b123312-48c0-4813-8aa5-a5b14b168660 tempest-VolumesSnapshotsTestJSON-1561196568 None] Lock "cinder-39787dcf-2be0-4e93-8cb0-28b5adcf1673-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:01:58 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Image download 20.69 MB at 20.69 MB/s Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd2f22-9efc-4e62-86fb-46660ae4c7a1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:58 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD Sep 02 00:01:58 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-199e96f6-c604-4bf3-b895-6ed54d5187e6 req-0f5f1a34-8ad1-4540-bda2-f0945555544f tempest-TestStampPattern-499105813 None] Terminate volume connection completed successfully. Sep 02 00:01:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-199e96f6-c604-4bf3-b895-6ed54d5187e6 req-0f5f1a34-8ad1-4540-bda2-f0945555544f tempest-TestStampPattern-499105813 None] Deleting attachment e289fa12-b9f1-48ec-85db-e4a651964992. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:01:59 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 is fetched for user 85465638080342de8fea08c2d4dcc7a3. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c60e2c-9c9f-4e35-8752-efd1ed3ea0ec]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:59 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD Sep 02 00:01:59 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:01:59 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1909211045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bfdd11-2a0a-43f1-8528-4d93bd010e41,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:01:58Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Creating volume c4bfdd11-2a0a-43f1-8528-4d93bd010e41 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:01:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:01:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:01:59 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 1073741824 Sep 02 00:01:59 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:00 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 1073741824" returned: 0 in 0.510s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:00 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 Sep 02 00:02:00 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:00 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41" returned: 0 in 0.287s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Attempting download of 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume c4bfdd11-2a0a-43f1-8528-4d93bd010e41. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9725ba4-93e8-41a4-b7b8-d3c3d67e96d9]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_b5l1y28c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:00 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_b5l1y28c Sep 02 00:02:00 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:00 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_b5l1y28c" returned: 0 in 0.406s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_b5l1y28c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:01 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_b5l1y28c Sep 02 00:02:01 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:01 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_b5l1y28c" returned: 1 in 0.562s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_b5l1y28c' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:02:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[848f1fad-4874-454e-8375-a4f6cd33d939]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:01 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD Sep 02 00:02:01 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:01 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:01 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] 7ac8008a-9a50-4a29-8129-58d061cbfda5 was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:02:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:01 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 Sep 02 00:02:01 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Flow 'volume_create_manager' (15239fe3-5d58-4d5e-8675-a982db5bc1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c539084e-340f-4ba0-ba53-4080fce9b097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c539084e-340f-4ba0-ba53-4080fce9b097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1610474423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ca3656-0f5f-4f6a-ab98-5c87f47f05b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b53707ae1e4a2c8c367ea259a5d0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:04Z,use_quota=True,user_id='dab115e99f6a48e5af4fa8f81bb9f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91e7103-fa67-4ed2-af16-b5cb70e9f200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91e7103-fa67-4ed2-af16-b5cb70e9f200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67998ad4-ff0e-494b-8dbb-5fb0b93f2b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67998ad4-ff0e-494b-8dbb-5fb0b93f2b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38ca3656-0f5f-4f6a-ab98-5c87f47f05b8', 'volume_name': 'volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f02c234-b509-4d8a-bc32-33682c227ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f02c234-b509-4d8a-bc32-33682c227ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348e1362-f37e-450f-83a2-e60be75f421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Volume 38ca3656-0f5f-4f6a-ab98-5c87f47f05b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8', 'volume_size': 1} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1610474423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ca3656-0f5f-4f6a-ab98-5c87f47f05b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b53707ae1e4a2c8c367ea259a5d0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:04Z,use_quota=True,user_id='dab115e99f6a48e5af4fa8f81bb9f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Creating volume 38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:03 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:03 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 1073741824 Sep 02 00:02:03 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Acquiring lock "cinder-9403cb45-38e0-4b00-a66a-5cf14cf7fab5-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Lock "cinder-9403cb45-38e0-4b00-a66a-5cf14cf7fab5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Acquiring lock "cinder-quobyte-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[be133ff9-c801-4cd2-91ef-63d578349075]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:04 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 Sep 02 00:02:04 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:04 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:04 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 1073741824" returned: 0 in 0.611s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41" returned: 0 in 2.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_6nmbisqtdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:02:04 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Converted 112.00 MB image at 45.71 MB/s Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:04 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 1G Sep 02 00:02:04 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:04 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 Sep 02 00:02:04 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:04 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" returned: 0 in 0.561s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:04 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5 Sep 02 00:02:04 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:04 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 1G" returned: 0 in 0.434s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Downloaded image 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume c4bfdd11-2a0a-43f1-8528-4d93bd010e41 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 for user 85465638080342de8fea08c2d4dcc7a3 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Marking volume c4bfdd11-2a0a-43f1-8528-4d93bd010e41 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:02:04 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Copying metadata from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 to c4bfdd11-2a0a-43f1-8528-4d93bd010e41. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Creating volume glance metadata for volume c4bfdd11-2a0a-43f1-8528-4d93bd010e41 backed by image 7ac8008a-9a50-4a29-8129-58d061cbfda5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348e1362-f37e-450f-83a2-e60be75f421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9c9452-2a3a-4979-8657-aea336695694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Volume volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 (38ca3656-0f5f-4f6a-ab98-5c87f47f05b8): created successfully Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9c9452-2a3a-4979-8657-aea336695694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Flow 'volume_create_manager' (15239fe3-5d58-4d5e-8675-a982db5bc1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:04 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4b09c6d2-4ea7-4903-9ad7-1fdd036e201e tempest-VolumesTestJSON-1187664822 None] Created volume successfully. Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" returned: 0 in 0.307s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-9403cb45-38e0-4b00-a66a-5cf14cf7fab5" released by "delete_volume" :: held 0.934s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7c24c7-5975-44ed-9112-f30908054a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42da0b70-8605-4902-895d-0332ffa082e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Created reservations ['eebf032f-5b38-4107-a615-d9f83bf34901', 'd98c605c-3de2-4c72-9c5a-9e0443aa4ed7', '597cd3a5-a2e5-4aa9-90ad-73d2bfd24db1', '7a00a32c-c45b-4707-9358-b2bb4ae2349a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Volume volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 (c4bfdd11-2a0a-43f1-8528-4d93bd010e41): created successfully Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42da0b70-8605-4902-895d-0332ffa082e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (b8e48b58-8631-466a-8984-1d53f175f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fcc2c8a8-74ff-4ac8-887a-3200a2c29f5b tempest-VolumesGetTest-1356324720 None] Created volume successfully. Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:05 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:05 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:05 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.236s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Deleted volume successfully. Sep 02 00:02:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a981db70-3a10-4f7a-998f-5c9b73523791 tempest-TestStampPattern-499105813 None] Lock "cinder-9403cb45-38e0-4b00-a66a-5cf14cf7fab5-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Flow 'volume_create_manager' (e26f2f29-883a-4fc6-b0f3-6d1a574b5726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b3b853-8a7e-44a5-a709-310643e2de75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b3b853-8a7e-44a5-a709-310643e2de75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1020594544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691e5d4f-0b62-45df-969e-c95cc68f1a61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b53707ae1e4a2c8c367ea259a5d0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:06Z,use_quota=True,user_id='dab115e99f6a48e5af4fa8f81bb9f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1eb0dfb-aaa2-4fc7-b338-c842221db970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1eb0dfb-aaa2-4fc7-b338-c842221db970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ecaeac-99b2-46d2-882b-d6018e9ec405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ecaeac-99b2-46d2-882b-d6018e9ec405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691e5d4f-0b62-45df-969e-c95cc68f1a61', 'volume_name': 'volume-691e5d4f-0b62-45df-969e-c95cc68f1a61', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e951a09b-371b-4140-89f1-e0f786ad1f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e951a09b-371b-4140-89f1-e0f786ad1f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce051cb7-d9ef-4a04-bc6a-14bc008a4993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Volume 691e5d4f-0b62-45df-969e-c95cc68f1a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691e5d4f-0b62-45df-969e-c95cc68f1a61', 'volume_size': 1} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1020594544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691e5d4f-0b62-45df-969e-c95cc68f1a61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b53707ae1e4a2c8c367ea259a5d0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:06Z,use_quota=True,user_id='dab115e99f6a48e5af4fa8f81bb9f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Creating volume 691e5d4f-0b62-45df-969e-c95cc68f1a61 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:06 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 1073741824 Sep 02 00:02:06 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:06 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:06 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Acquiring lock "cinder-c7fce037-72b0-489f-b2a6-6787d7b4123f-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Lock "cinder-c7fce037-72b0-489f-b2a6-6787d7b4123f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Acquiring lock "cinder-quobyte-e24617a4-fbaf-491d-8ae7-7882cafc7a57" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-e24617a4-fbaf-491d-8ae7-7882cafc7a57" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Acquiring lock "cinder-quobyte-c7fce037-72b0-489f-b2a6-6787d7b4123f" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-c7fce037-72b0-489f-b2a6-6787d7b4123f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Deleting offline snapshot c7fce037-72b0-489f-b2a6-6787d7b4123f of volume e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] snapshot_file for this snap is: volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d621b3-ffed-4005-815f-c3e6b41c2401]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:06 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.359s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:06 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f Sep 02 00:02:06 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:02:06 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 1073741824" returned: 0 in 0.630s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:07 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 Sep 02 00:02:07 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (fe4a73d4-0beb-4437-ad0c-912fa4c19baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3f0046-ed76-423f-bcfa-f073b9abc825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3f0046-ed76-423f-bcfa-f073b9abc825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1315998126',display_name='tempest-VolumesGetTest-Volume-16836290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dbaaba-9b76-4a8e-922f-1f091ba6e6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:07Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e96422-49ff-43f8-8491-6eb873c30d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:07 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e96422-49ff-43f8-8491-6eb873c30d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca0cc49-e162-4e5a-ab75-f1a946db16f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca0cc49-e162-4e5a-ab75-f1a946db16f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24dbaaba-9b76-4a8e-922f-1f091ba6e6fa', 'volume_name': 'volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c5ae48-ffc8-42bf-ab27-0732a08bcab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c5ae48-ffc8-42bf-ab27-0732a08bcab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb7f3e1-84a5-4293-874f-6563130820ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Volume 24dbaaba-9b76-4a8e-922f-1f091ba6e6fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa', 'volume_size': 1} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f" returned: 0 in 0.517s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:02:07 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1315998126',display_name='tempest-VolumesGetTest-Volume-16836290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dbaaba-9b76-4a8e-922f-1f091ba6e6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6acabc755143799fe15f17bdd82339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:07Z,use_quota=True,user_id='85465638080342de8fea08c2d4dcc7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Creating volume 24dbaaba-9b76-4a8e-922f-1f091ba6e6fa {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:07 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b191e2a-4d1f-47aa-9278-993f16b01a61]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:07 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa 1073741824 Sep 02 00:02:07 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce051cb7-d9ef-4a04-bc6a-14bc008a4993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691e5d4f-0b62-45df-969e-c95cc68f1a61', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3235ad-2962-4512-8bb3-98ece221062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Volume volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 (691e5d4f-0b62-45df-969e-c95cc68f1a61): created successfully Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3235ad-2962-4512-8bb3-98ece221062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Flow 'volume_create_manager' (e26f2f29-883a-4fc6-b0f3-6d1a574b5726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ae516be7-54bc-4e57-b162-f690377aa5d1 tempest-VolumesTestJSON-1187664822 None] Created volume successfully. Sep 02 00:02:07 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 Sep 02 00:02:07 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:07 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa 1073741824" returned: 0 in 0.505s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:07 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa Sep 02 00:02:07 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:07 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57" returned: 0 in 0.595s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:07 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f Sep 02 00:02:07 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:08 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa" returned: 0 in 0.302s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb7f3e1-84a5-4293-874f-6563130820ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda19af7-ba6f-4c29-9588-712536b479a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Volume volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa (24dbaaba-9b76-4a8e-922f-1f091ba6e6fa): created successfully Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda19af7-ba6f-4c29-9588-712536b479a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Flow 'volume_create_manager' (fe4a73d4-0beb-4437-ad0c-912fa4c19baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-617291a3-727e-48a2-ae89-3fc9047bc21e tempest-VolumesGetTest-1356324720 None] Created volume successfully. Sep 02 00:02:08 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f" returned: 0 in 0.639s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:08 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f Sep 02 00:02:08 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:08 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57.c7fce037-72b0-489f-b2a6-6787d7b4123f" returned: 0 in 0.369s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-c7fce037-72b0-489f-b2a6-6787d7b4123f" released by "_delete_snapshot" :: held 2.264s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-e24617a4-fbaf-491d-8ae7-7882cafc7a57" released by "delete_snapshot" :: held 2.296s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Created reservations ['323931e7-eee9-4842-b46b-cd15836b0b56', '752bbf0f-bad0-4976-b735-74636c485658', 'cdddf41d-2962-46b8-88f8-6942f52c98d2', '9e9ed184-3a4b-47e4-bde0-5def46acb744'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Delete snapshot completed successfully. Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3a636f06-e8b3-4647-b003-630c88445953 tempest-TestStampPattern-499105813 None] Lock "cinder-c7fce037-72b0-489f-b2a6-6787d7b4123f-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Flow 'volume_create_manager' (c8186401-cee9-4564-89f7-24c8a1d2e494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f895bdc-78de-4895-b594-14ac9d25719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f895bdc-78de-4895-b594-14ac9d25719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-886043728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7baeac-824a-4689-b1c0-5f3e1fd482e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b53707ae1e4a2c8c367ea259a5d0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:09Z,use_quota=True,user_id='dab115e99f6a48e5af4fa8f81bb9f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55eaa320-c971-4fd3-88d2-1a307ed54dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55eaa320-c971-4fd3-88d2-1a307ed54dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c60ed23-9145-4702-bdc9-2fe35e389aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c60ed23-9145-4702-bdc9-2fe35e389aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7baeac-824a-4689-b1c0-5f3e1fd482e1', 'volume_name': 'volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4556627a-adbb-47dd-8c3e-21a602d0bea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4556627a-adbb-47dd-8c3e-21a602d0bea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a520d24-3081-41e6-afc3-e214af349b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Volume ee7baeac-824a-4689-b1c0-5f3e1fd482e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1', 'volume_size': 1} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-886043728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7baeac-824a-4689-b1c0-5f3e1fd482e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b53707ae1e4a2c8c367ea259a5d0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:09Z,use_quota=True,user_id='dab115e99f6a48e5af4fa8f81bb9f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Creating volume ee7baeac-824a-4689-b1c0-5f3e1fd482e1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:09 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:09 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 1073741824 Sep 02 00:02:09 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Lock "cinder-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-quobyte-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ebdbcd-6c71-422c-bb0e-40c2dcf3a44d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:09 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa Sep 02 00:02:09 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:10 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 1073741824" returned: 0 in 0.668s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:10 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa" returned: 0 in 0.500s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:10 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa Sep 02 00:02:10 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:10 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 Sep 02 00:02:10 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:10 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa" released by "delete_volume" :: held 0.851s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Created reservations ['5dc74091-249b-47ae-b389-f60c71f99193', 'd9ed61d4-f6b9-482a-a0d0-5efdd4b9d566', 'b139a633-7e6e-4438-a077-a7f4b39148a2', '2db0de07-a89d-4a8d-be7e-e28793024d0f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:10 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a520d24-3081-41e6-afc3-e214af349b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c95557-396c-4629-a70a-c4f6652b0f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Volume volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 (ee7baeac-824a-4689-b1c0-5f3e1fd482e1): created successfully Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c95557-396c-4629-a70a-c4f6652b0f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Flow 'volume_create_manager' (c8186401-cee9-4564-89f7-24c8a1d2e494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-71f2cffb-ba20-410d-b4de-32968f08d393 tempest-VolumesTestJSON-1187664822 None] Created volume successfully. Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:10 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:10 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-c4bfdd11-2a0a-43f1-8528-4d93bd010e41-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Lock "cinder-c4bfdd11-2a0a-43f1-8528-4d93bd010e41-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Acquiring lock "cinder-quobyte-c4bfdd11-2a0a-43f1-8528-4d93bd010e41" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-c4bfdd11-2a0a-43f1-8528-4d93bd010e41" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f4e782-1240-4e86-9b2c-9a51435e7838]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:11 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.406s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Deleted volume successfully. Sep 02 00:02:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6027ebde-7d52-49a7-8aae-ed37202aeb31 tempest-VolumesGetTest-1356324720 None] Lock "cinder-24dbaaba-9b76-4a8e-922f-1f091ba6e6fa-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:11 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 Sep 02 00:02:11 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:11 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41" returned: 0 in 0.621s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:11 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41 Sep 02 00:02:11 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:12 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c4bfdd11-2a0a-43f1-8528-4d93bd010e41" returned: 0 in 0.546s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Lock "cinder-quobyte-c4bfdd11-2a0a-43f1-8528-4d93bd010e41" released by "delete_volume" :: held 1.249s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Created reservations ['f79e8354-f473-4cc3-b4fd-14591db7e86e', '56d8a85f-426a-44f3-81bd-cd9d89ec660b', '034e18ff-5f61-47ee-b28b-dc787c4c0598', '3ea0aba4-aa9d-4311-89bf-8435d8b6033a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:12 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:12 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:12 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.407s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Deleted volume successfully. Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "cinder-ee7baeac-824a-4689-b1c0-5f3e1fd482e1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ba7eb324-2d50-4060-b60f-6b3c0c488ae0 tempest-VolumesGetTest-1356324720 None] Lock "cinder-c4bfdd11-2a0a-43f1-8528-4d93bd010e41-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-ee7baeac-824a-4689-b1c0-5f3e1fd482e1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "cinder-quobyte-ee7baeac-824a-4689-b1c0-5f3e1fd482e1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-quobyte-ee7baeac-824a-4689-b1c0-5f3e1fd482e1" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae5c423-180d-4d25-be2a-3c524d904be7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:13 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 Sep 02 00:02:13 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:13 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1" returned: 0 in 0.651s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:13 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1 Sep 02 00:02:13 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:13 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ee7baeac-824a-4689-b1c0-5f3e1fd482e1" returned: 0 in 0.301s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-quobyte-ee7baeac-824a-4689-b1c0-5f3e1fd482e1" released by "delete_volume" :: held 1.014s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Created reservations ['0330fa34-c537-4b3d-846d-bec134b0c383', '98f17781-2a39-4025-836e-7ca51eede28f', 'd356be9b-8441-4144-b9e2-16c4b96527a8', 'cd5d2c85-3a37-420a-a8ba-cf4a495f7c2a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:14 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:14 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-00a55f54-7342-4c0f-acfa-f12807b0bc29 req-f85bc242-1d79-45cf-9f16-bb2188327a36 tempest-AttachVolumeNegativeTest-328114835 None] Terminate volume connection completed successfully. Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-00a55f54-7342-4c0f-acfa-f12807b0bc29 req-f85bc242-1d79-45cf-9f16-bb2188327a36 tempest-AttachVolumeNegativeTest-328114835 None] Deleting attachment 0ad3383b-976e-469e-928e-bade64c4a518. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:02:14 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.313s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Deleted volume successfully. Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e3206ce-24cb-44d1-bdbb-3cd7cf2d7d13 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-ee7baeac-824a-4689-b1c0-5f3e1fd482e1-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Acquiring lock "cinder-e24617a4-fbaf-491d-8ae7-7882cafc7a57-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Lock "cinder-e24617a4-fbaf-491d-8ae7-7882cafc7a57-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Acquiring lock "cinder-quobyte-e24617a4-fbaf-491d-8ae7-7882cafc7a57" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-e24617a4-fbaf-491d-8ae7-7882cafc7a57" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[55489858-969b-4ccc-bfb5-1dbf57f2a38e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:14 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 Sep 02 00:02:14 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:15 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57" returned: 0 in 0.442s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:15 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57 Sep 02 00:02:15 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "cinder-691e5d4f-0b62-45df-969e-c95cc68f1a61-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-691e5d4f-0b62-45df-969e-c95cc68f1a61-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "cinder-quobyte-691e5d4f-0b62-45df-969e-c95cc68f1a61" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-quobyte-691e5d4f-0b62-45df-969e-c95cc68f1a61" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[850208f9-b2ab-4b4c-8375-76ea2869f01f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:15 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e24617a4-fbaf-491d-8ae7-7882cafc7a57" returned: 0 in 0.360s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Lock "cinder-quobyte-e24617a4-fbaf-491d-8ae7-7882cafc7a57" released by "delete_volume" :: held 0.886s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:15 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 Sep 02 00:02:15 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Created reservations ['ba929ed5-172e-476f-bf31-e3b4121de079', '2b3e3ed0-b09e-41b2-ae29-5f36110d8168', 'b7afa521-41f8-4a69-a811-991e1dc2a295', '9ae7f211-bf96-4560-8840-65ca57c1d9c6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:16 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:16 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:16 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61" returned: 0 in 0.731s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:16 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61 Sep 02 00:02:16 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:16 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.312s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Deleted volume successfully. Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24f66009-ef55-4673-8e40-84117e50ca1a tempest-TestStampPattern-499105813 None] Lock "cinder-e24617a4-fbaf-491d-8ae7-7882cafc7a57-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:16 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-691e5d4f-0b62-45df-969e-c95cc68f1a61" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-quobyte-691e5d4f-0b62-45df-969e-c95cc68f1a61" released by "delete_volume" :: held 1.157s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Created reservations ['8ee305fc-d256-4ee6-a974-5f1010163ab3', '6bbea260-69d7-438e-bc04-5ed40e73e4e1', 'aff4727a-670f-4a06-af1e-97f0c8862c8b', 'ff31d2c6-954e-40a5-ac63-4e2468e9632a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:16 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:16 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:16 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.327s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:16 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Deleted volume successfully. Sep 02 00:02:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d79397a6-9075-41d6-9d10-05f2db96fe74 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-691e5d4f-0b62-45df-969e-c95cc68f1a61-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "cinder-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "cinder-quobyte-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-quobyte-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e37f2f7-2696-439f-b3a1-4fd15268a9b7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:17 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 Sep 02 00:02:17 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:18 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8" returned: 0 in 0.576s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:18 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8 Sep 02 00:02:18 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=180,cinder:SELECT=130,cinder:INSERT=43,cinder:DELETE=16 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:02:18 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-quobyte-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8" released by "delete_volume" :: held 1.008s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Created reservations ['c9abac74-e46c-4adb-9ce3-25b5c396af04', '94a78e38-44b0-4eef-8c1f-f8bbac84e198', '6ad3ccf0-593a-41b0-867f-5790976a9219', '8e0fecb8-1769-4878-a118-d60e419742de'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:18 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:18 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:19 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.310s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Deleted volume successfully. Sep 02 00:02:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-933e49ec-d07b-40b6-9641-3e27ce94d902 tempest-VolumesTestJSON-1187664822 None] Lock "cinder-38ca3656-0f5f-4f6a-ab98-5c87f47f05b8-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:02:29 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=122,cinder:DELETE=7,cinder:SELECT=110,cinder:INSERT=36 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (47714cb7-04d1-41a6-8c82-019a27317fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5099c6e-238f-4b85-a139-9221d9a45ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5099c6e-238f-4b85-a139-9221d9a45ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468146559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6897d1-79bf-4eb4-9b5c-dab0b87fd764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:37Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c13138-7b80-42b6-941e-5671c4972a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c13138-7b80-42b6-941e-5671c4972a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfd94e2-4dc3-42ae-aecc-b47bc6cef25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfd94e2-4dc3-42ae-aecc-b47bc6cef25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6897d1-79bf-4eb4-9b5c-dab0b87fd764', 'volume_name': 'volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e850afac-a825-4413-bb9a-7da2830e5409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e850afac-a825-4413-bb9a-7da2830e5409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3fe945-e19c-4869-9844-301b48f33b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume be6897d1-79bf-4eb4-9b5c-dab0b87fd764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764', 'volume_size': 1} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468146559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6897d1-79bf-4eb4-9b5c-dab0b87fd764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:37Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Creating volume be6897d1-79bf-4eb4-9b5c-dab0b87fd764 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:37 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:37 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 1073741824 Sep 02 00:02:37 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:38 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 1073741824" returned: 0 in 0.480s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:38 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 Sep 02 00:02:38 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:38 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764" returned: 0 in 0.340s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3fe945-e19c-4869-9844-301b48f33b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3325053a-88c2-48b1-b6c2-2fecdba65d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 (be6897d1-79bf-4eb4-9b5c-dab0b87fd764): created successfully Sep 02 00:02:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3325053a-88c2-48b1-b6c2-2fecdba65d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (47714cb7-04d1-41a6-8c82-019a27317fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b5bcecef-6a20-4a59-a802-dc9c77536187 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created volume successfully. Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (ad796322-35ad-443f-bab3-125c23804cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952758ac-26d2-4304-bfbd-d0e184a77309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952758ac-26d2-4304-bfbd-d0e184a77309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-172852715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be066a08-fe1d-48ac-8e60-16608c2031b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:40Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfcbff1-08fa-4403-96db-294b4d46d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfcbff1-08fa-4403-96db-294b4d46d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7061761d-36f5-4a06-9f0a-a62cd5e14038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7061761d-36f5-4a06-9f0a-a62cd5e14038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be066a08-fe1d-48ac-8e60-16608c2031b7', 'volume_name': 'volume-be066a08-fe1d-48ac-8e60-16608c2031b7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cc991c-6345-48ee-a116-8c56dcb0a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cc991c-6345-48ee-a116-8c56dcb0a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ad4342-cf9a-4fa0-94e8-8027b17161ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume be066a08-fe1d-48ac-8e60-16608c2031b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be066a08-fe1d-48ac-8e60-16608c2031b7', 'volume_size': 1} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-172852715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be066a08-fe1d-48ac-8e60-16608c2031b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:40Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Creating volume be066a08-fe1d-48ac-8e60-16608c2031b7 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:40 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:40 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7 1073741824 Sep 02 00:02:40 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (6d217e63-091b-49f6-82a5-9c7cb3427c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0dff41-ef3c-4b04-8b66-b2fb412824de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0dff41-ef3c-4b04-8b66-b2fb412824de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185691708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9d3139-8136-459b-b975-02b3a5c57404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:41Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357c7095-e893-4a1f-ad35-d656ba8f60a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357c7095-e893-4a1f-ad35-d656ba8f60a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd923e9-a0a2-4231-a9eb-c3c17481c1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd923e9-a0a2-4231-a9eb-c3c17481c1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9d3139-8136-459b-b975-02b3a5c57404', 'volume_name': 'volume-0d9d3139-8136-459b-b975-02b3a5c57404', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16231e1-d14f-4053-b5e6-5189310cba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16231e1-d14f-4053-b5e6-5189310cba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1785286c-7758-431f-803a-ea5aa51bd485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume 0d9d3139-8136-459b-b975-02b3a5c57404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9d3139-8136-459b-b975-02b3a5c57404', 'volume_size': 1} Sep 02 00:02:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:41 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7 1073741824" returned: 0 in 0.704s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:41 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7 Sep 02 00:02:41 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (b344214b-9446-4fb4-8284-2dc8df7ee2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bf9919-8e28-415e-910d-62ea46be82b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bf9919-8e28-415e-910d-62ea46be82b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289566113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8386942f-3b27-4edb-b4bf-0f9729be7e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:41Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d4a4ab-bc98-4568-b337-aae75cd19e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d4a4ab-bc98-4568-b337-aae75cd19e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae1b70e-56d6-4020-bec1-9ce9fa5a10a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae1b70e-56d6-4020-bec1-9ce9fa5a10a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8386942f-3b27-4edb-b4bf-0f9729be7e89', 'volume_name': 'volume-8386942f-3b27-4edb-b4bf-0f9729be7e89', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381010a5-8ee7-40cf-ac91-3d19bb305c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381010a5-8ee7-40cf-ac91-3d19bb305c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6d0bcc-f754-4a4c-aad4-28a06a6597b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume 8386942f-3b27-4edb-b4bf-0f9729be7e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8386942f-3b27-4edb-b4bf-0f9729be7e89', 'volume_size': 1} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:41 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7" returned: 0 in 0.488s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185691708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9d3139-8136-459b-b975-02b3a5c57404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:41Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Creating volume 0d9d3139-8136-459b-b975-02b3a5c57404 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:41 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:41 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404 1073741824 Sep 02 00:02:41 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ad4342-cf9a-4fa0-94e8-8027b17161ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be066a08-fe1d-48ac-8e60-16608c2031b7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2786f9-5f57-4c41-b378-57482b3c172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume volume-be066a08-fe1d-48ac-8e60-16608c2031b7 (be066a08-fe1d-48ac-8e60-16608c2031b7): created successfully Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2786f9-5f57-4c41-b378-57482b3c172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (ad796322-35ad-443f-bab3-125c23804cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7bc69cff-5b00-49ee-aa11-5d7613fc939c tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created volume successfully. Sep 02 00:02:41 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (61e7afa3-8427-4e08-9b0c-c4c25645c221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a73b21a-96c0-400c-924e-aa6645c3dc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a73b21a-96c0-400c-924e-aa6645c3dc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670376891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127371e6-7c56-453c-bdd6-bfc0688bfed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:42Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bab105c-ca24-4f2a-9cf4-62833a99c146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bab105c-ca24-4f2a-9cf4-62833a99c146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd29ecf-9cf5-48b8-9a42-bcfbf99239ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd29ecf-9cf5-48b8-9a42-bcfbf99239ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127371e6-7c56-453c-bdd6-bfc0688bfed7', 'volume_name': 'volume-127371e6-7c56-453c-bdd6-bfc0688bfed7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa12bb50-b714-47b6-be9d-b768f65c3377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa12bb50-b714-47b6-be9d-b768f65c3377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7b30d7-b16b-45e9-9303-bfa5e9bdd308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume 127371e6-7c56-453c-bdd6-bfc0688bfed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127371e6-7c56-453c-bdd6-bfc0688bfed7', 'volume_size': 1} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (f38ccd7b-a2fe-48be-9a93-73fd840a097c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:42 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897263db-6fbe-4f63-a289-c3ec6c0f2cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404 1073741824" returned: 0 in 0.767s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897263db-6fbe-4f63-a289-c3ec6c0f2cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1018755448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbb92dd-9cc2-4b02-ba6c-619399d5eb71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:42Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c95ef68-1328-447e-88c9-4064626197ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c95ef68-1328-447e-88c9-4064626197ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6993a4c8-fded-47cd-9acd-71c00b566056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6993a4c8-fded-47cd-9acd-71c00b566056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbb92dd-9cc2-4b02-ba6c-619399d5eb71', 'volume_name': 'volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02c7a41-5095-4fa5-b1f9-ef2eeb314a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02c7a41-5095-4fa5-b1f9-ef2eeb314a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41ab3db-8fca-4dd4-bc39-6c3bf80594ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume ecbb92dd-9cc2-4b02-ba6c-619399d5eb71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71', 'volume_size': 1} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:42 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404 Sep 02 00:02:42 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:42 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404" returned: 0 in 0.289s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289566113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8386942f-3b27-4edb-b4bf-0f9729be7e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:41Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Creating volume 8386942f-3b27-4edb-b4bf-0f9729be7e89 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:42 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1785286c-7758-431f-803a-ea5aa51bd485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9d3139-8136-459b-b975-02b3a5c57404', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3558c6d-da51-4d69-a651-869ab565620b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:42 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 1073741824 Sep 02 00:02:42 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume volume-0d9d3139-8136-459b-b975-02b3a5c57404 (0d9d3139-8136-459b-b975-02b3a5c57404): created successfully Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3558c6d-da51-4d69-a651-869ab565620b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (6d217e63-091b-49f6-82a5-9c7cb3427c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2260fb95-6e13-416a-9681-41c930cacea0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created volume successfully. Sep 02 00:02:44 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 1073741824" returned: 0 in 1.149s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:44 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 Sep 02 00:02:44 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:44 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89" returned: 0 in 0.508s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.524s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670376891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127371e6-7c56-453c-bdd6-bfc0688bfed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:42Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Creating volume 127371e6-7c56-453c-bdd6-bfc0688bfed7 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:44 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:44 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 1073741824 Sep 02 00:02:44 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6d0bcc-f754-4a4c-aad4-28a06a6597b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8386942f-3b27-4edb-b4bf-0f9729be7e89', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d78b810-623c-48ca-b23e-f113e8e5db46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:44 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 (8386942f-3b27-4edb-b4bf-0f9729be7e89): created successfully Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d78b810-623c-48ca-b23e-f113e8e5db46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (b344214b-9446-4fb4-8284-2dc8df7ee2f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bf2bba36-ab01-4a4a-9c8d-b835dc288e94 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created volume successfully. Sep 02 00:02:45 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 1073741824" returned: 0 in 1.037s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:45 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 Sep 02 00:02:45 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:46 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.709s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1018755448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbb92dd-9cc2-4b02-ba6c-619399d5eb71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b448f8253b48c08262f7fd46a676f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:42Z,use_quota=True,user_id='58525750a0e248b6a7a6b5ab3b827bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Creating volume ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:46 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7b30d7-b16b-45e9-9303-bfa5e9bdd308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127371e6-7c56-453c-bdd6-bfc0688bfed7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:46 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 1073741824 Sep 02 00:02:46 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75be06c0-6c98-4654-a386-3c3ad42c04bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 (127371e6-7c56-453c-bdd6-bfc0688bfed7): created successfully Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75be06c0-6c98-4654-a386-3c3ad42c04bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (61e7afa3-8427-4e08-9b0c-c4c25645c221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2b42b4a7-94a5-4460-8d40-2a9f4188a264 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created volume successfully. Sep 02 00:02:47 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 1073741824" returned: 0 in 0.774s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:47 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 Sep 02 00:02:47 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Flow 'volume_create_manager' (f79b4353-b7ee-42be-b71c-da85fa23766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526177b3-e9d4-4198-9382-68789e4e6e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526177b3-e9d4-4198-9382-68789e4e6e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1130390339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a328b04d-83c9-4484-8ee4-567d2eba8aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc0d5cb7ece4c1ead8d0f7a4bc4e16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:48Z,use_quota=True,user_id='775b4cc6cae648a2aed60c2a8b303aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1022af8-5219-43ac-9a9a-c22774d080ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1022af8-5219-43ac-9a9a-c22774d080ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e7ee86-b5aa-4716-8ed9-f841d484c033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e7ee86-b5aa-4716-8ed9-f841d484c033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a328b04d-83c9-4484-8ee4-567d2eba8aa6', 'volume_name': 'volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4808ff-24b3-4777-ad0d-f430fb5cad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4808ff-24b3-4777-ad0d-f430fb5cad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afcfd0e-676e-4015-a99c-b7f6742e614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Volume a328b04d-83c9-4484-8ee4-567d2eba8aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6', 'volume_size': 1} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:47 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71" returned: 0 in 0.652s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1130390339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a328b04d-83c9-4484-8ee4-567d2eba8aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc0d5cb7ece4c1ead8d0f7a4bc4e16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:48Z,use_quota=True,user_id='775b4cc6cae648a2aed60c2a8b303aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Creating volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:47 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:47 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 1073741824 Sep 02 00:02:47 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41ab3db-8fca-4dd4-bc39-6c3bf80594ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292ac35c-6380-4fff-b27d-9e7d1a7a924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Volume volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 (ecbb92dd-9cc2-4b02-ba6c-619399d5eb71): created successfully Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292ac35c-6380-4fff-b27d-9e7d1a7a924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Flow 'volume_create_manager' (f38ccd7b-a2fe-48be-9a93-73fd840a097c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-744f1c8e-2da1-46bb-9058-2500f2612e7e tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created volume successfully. Sep 02 00:02:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-quobyte-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:48 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 1073741824" returned: 0 in 0.831s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef79fa5-d177-4c85-bb9a-0bec6ae34c69]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:48 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 Sep 02 00:02:48 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:48 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 Sep 02 00:02:48 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:49 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afcfd0e-676e-4015-a99c-b7f6742e614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c542dac3-7a66-4505-9b3f-a3e5e63dbfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Volume volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 (a328b04d-83c9-4484-8ee4-567d2eba8aa6): created successfully Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c542dac3-7a66-4505-9b3f-a3e5e63dbfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Flow 'volume_create_manager' (f79b4353-b7ee-42be-b71c-da85fa23766f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2481bf66-1227-485c-8468-f80602014ac7 tempest-SnapshotsActionsTest-454500508 None] Created volume successfully. Sep 02 00:02:49 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71" returned: 0 in 0.617s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:49 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71 Sep 02 00:02:49 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:49 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71" released by "delete_volume" :: held 1.138s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created reservations ['4aa3db2c-04fb-42a2-b382-abc13884b5a0', '3c163ccc-3032-43b4-a325-e5ee7c32ff60', 'd6636ddf-ee45-46e8-8847-8e72802d66c8', '8c9fe0ca-bec5-4255-8a45-f8107ed966d9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:50 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:50 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Creating offline snapshot ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a50cb29-d035-49f7-9cf5-3ac9ac142b99]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:50 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 Sep 02 00:02:50 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:50 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.345s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Deleted volume successfully. Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7d5929ef-9efc-4cce-905a-acbbf2beccf7 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-ecbb92dd-9cc2-4b02-ba6c-619399d5eb71-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:50 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6" returned: 0 in 0.506s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:50 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 1G Sep 02 00:02:50 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-127371e6-7c56-453c-bdd6-bfc0688bfed7-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-127371e6-7c56-453c-bdd6-bfc0688bfed7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-quobyte-127371e6-7c56-453c-bdd6-bfc0688bfed7" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-127371e6-7c56-453c-bdd6-bfc0688bfed7" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7636ee50-87dc-44f0-8913-705d3f8b4785]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:51 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 1G" returned: 0 in 0.567s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:51 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 Sep 02 00:02:51 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:51 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:02:51 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:51 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:51 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7" returned: 0 in 0.455s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:51 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 is being set with open permissions: ugo+rw Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:51 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:02:51 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:51 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7 Sep 02 00:02:51 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:51 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:51 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-127371e6-7c56-453c-bdd6-bfc0688bfed7" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-127371e6-7c56-453c-bdd6-bfc0688bfed7" released by "delete_volume" :: held 0.856s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:51 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.info Sep 02 00:02:51 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created reservations ['a60a02bf-4f7a-419e-a70d-4d72bd9c2994', 'c1390acd-e135-4e62-9b09-f8d8841561c1', '706d4c65-0e26-4fe9-a70c-daab25ce46e3', '72a72dbd-20fc-40cc-831c-356d18b7b140'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:52 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:52 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Flow 'volume_create_manager' (a6dc4da8-3044-4eb8-ae4c-51d4157c1287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561bddad-2a23-4684-99a9-65b572e0fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:52 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.info" returned: 0 in 0.428s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:52 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.info is being set with open permissions: ugo+rw Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561bddad-2a23-4684-99a9-65b572e0fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1004569480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d1994a-9143-44f0-b6a0-3e1d56b484be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4a8f52e6a247a289159bd0ac1096a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:52Z,use_quota=True,user_id='862d5080ccf04c24b7282dafa330d106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bafda94-787b-4749-b6c9-1eac931a2cef),volume_type_id=1bafda94-787b-4749-b6c9-1eac931a2cef)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:52 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.info Sep 02 00:02:52 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa710861-0fc5-4d4d-ba66-6882f20cdcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa710861-0fc5-4d4d-ba66-6882f20cdcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6eb0b1-c588-41a9-9c7e-a2646ec959cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6eb0b1-c588-41a9-9c7e-a2646ec959cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d1994a-9143-44f0-b6a0-3e1d56b484be', 'volume_name': 'volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd8761b-1a28-4656-9e5c-05fab7d825b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd8761b-1a28-4656-9e5c-05fab7d825b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad70b34-e053-43a6-b9df-e8b6fe047d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Volume e9d1994a-9143-44f0-b6a0-3e1d56b484be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be', 'volume_size': 1} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:52 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Deleted volume successfully. Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-60922ef7-5ecf-4c2a-9851-2cbe45a30f37 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-127371e6-7c56-453c-bdd6-bfc0688bfed7-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:52 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.info" returned: 0 in 0.514s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.780s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1004569480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d1994a-9143-44f0-b6a0-3e1d56b484be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4a8f52e6a247a289159bd0ac1096a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:52Z,use_quota=True,user_id='862d5080ccf04c24b7282dafa330d106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bafda94-787b-4749-b6c9-1eac931a2cef),volume_type_id=1bafda94-787b-4749-b6c9-1eac931a2cef)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Creating volume e9d1994a-9143-44f0-b6a0-3e1d56b484be {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:52 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:52 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be 1073741824 Sep 02 00:02:52 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fd8660ca-e96a-4ce6-9feb-c5cf29629af6 tempest-SnapshotsActionsTest-454500508 None] Create snapshot completed successfully Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Flow 'volume_create_manager' (e5e7d718-e1bb-43f5-84c8-71307dad3d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4d6e9a-8122-4c25-9438-a41d369f0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4d6e9a-8122-4c25-9438-a41d369f0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-264019235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23af3b84-d51c-48bb-8321-f904c73540ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4a8f52e6a247a289159bd0ac1096a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:53Z,use_quota=True,user_id='862d5080ccf04c24b7282dafa330d106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4937c28-d9f8-42b6-8021-0024c3b1f1b2),volume_type_id=f4937c28-d9f8-42b6-8021-0024c3b1f1b2)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a08e1e-3b8b-47ef-85db-a045ae7dd1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a08e1e-3b8b-47ef-85db-a045ae7dd1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5c87d2-b4da-442a-9de0-287a8bffd8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5c87d2-b4da-442a-9de0-287a8bffd8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23af3b84-d51c-48bb-8321-f904c73540ca', 'volume_name': 'volume-23af3b84-d51c-48bb-8321-f904c73540ca', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5305e6-790a-4436-ac9e-4e9066529670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5305e6-790a-4436-ac9e-4e9066529670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00843df0-f0c2-4d89-9198-d7b61eaaf37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Volume 23af3b84-d51c-48bb-8321-f904c73540ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23af3b84-d51c-48bb-8321-f904c73540ca', 'volume_size': 1} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-8386942f-3b27-4edb-b4bf-0f9729be7e89-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-8386942f-3b27-4edb-b4bf-0f9729be7e89-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-quobyte-8386942f-3b27-4edb-b4bf-0f9729be7e89" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-8386942f-3b27-4edb-b4bf-0f9729be7e89" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b5c93e-1554-4592-aefa-62fd4876ad74]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:53 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be 1073741824" returned: 0 in 0.677s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:53 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 Sep 02 00:02:53 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:53 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be Sep 02 00:02:53 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:53 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89" returned: 0 in 0.575s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Flow 'volume_create_manager' (5e1d69de-0f2d-4250-b0e3-961404d5c2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a576640c-432e-4c82-938e-a4587ce4560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:54 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89 Sep 02 00:02:54 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:54 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a576640c-432e-4c82-938e-a4587ce4560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1110596730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872cae90-3e88-414e-9b20-c8f572e21e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4a8f52e6a247a289159bd0ac1096a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:54Z,use_quota=True,user_id='862d5080ccf04c24b7282dafa330d106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b19a07f-5941-404e-b49e-832ec645ed4e),volume_type_id=4b19a07f-5941-404e-b49e-832ec645ed4e)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef47da4-11ed-4bfd-ac7e-947b5ddc239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef47da4-11ed-4bfd-ac7e-947b5ddc239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f66627-2496-442f-a360-06719ab332e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be" returned: 0 in 0.532s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.091s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-264019235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23af3b84-d51c-48bb-8321-f904c73540ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4a8f52e6a247a289159bd0ac1096a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:53Z,use_quota=True,user_id='862d5080ccf04c24b7282dafa330d106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4937c28-d9f8-42b6-8021-0024c3b1f1b2),volume_type_id=f4937c28-d9f8-42b6-8021-0024c3b1f1b2)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Creating volume 23af3b84-d51c-48bb-8321-f904c73540ca {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:02:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad70b34-e053-43a6-b9df-e8b6fe047d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99269dca-5ed2-4f8c-beb2-d6007ef0b9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:54 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca 1073741824 Sep 02 00:02:54 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Volume volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be (e9d1994a-9143-44f0-b6a0-3e1d56b484be): created successfully Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99269dca-5ed2-4f8c-beb2-d6007ef0b9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Flow 'volume_create_manager' (a6dc4da8-3044-4eb8-ae4c-51d4157c1287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4955f1ba-e2d1-4692-a08d-047f1ea33c35 tempest-TestInstancesWithCinderVolumes-2010248593 None] Created volume successfully. Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:54 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8386942f-3b27-4edb-b4bf-0f9729be7e89" returned: 0 in 0.499s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-8386942f-3b27-4edb-b4bf-0f9729be7e89" released by "delete_volume" :: held 1.141s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f66627-2496-442f-a360-06719ab332e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '872cae90-3e88-414e-9b20-c8f572e21e92', 'volume_name': 'volume-872cae90-3e88-414e-9b20-c8f572e21e92', 'volume_size': 1, 'image_id': 'ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--165406024', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d4a8f52e6a247a289159bd0ac1096a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'created_at': datetime.datetime(2026, 9, 1, 22, 2, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 2, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba1a27ee-dd34-4cff-9f6f-45fe58c996dd/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ecc905-c3a4-43ba-91a5-3b54d2db9252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ecc905-c3a4-43ba-91a5-3b54d2db9252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7756e76-b232-4618-a3f6-b4de136af0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Volume 872cae90-3e88-414e-9b20-c8f572e21e92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-872cae90-3e88-414e-9b20-c8f572e21e92', 'volume_size': 1, 'image_id': 'ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--165406024', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d4a8f52e6a247a289159bd0ac1096a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'created_at': datetime.datetime(2026, 9, 1, 22, 2, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 2, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba1a27ee-dd34-4cff-9f6f-45fe58c996dd/file', 'properties': {}}, 'image_service': } Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Trying to clone 872cae90-3e88-414e-9b20-c8f572e21e92 from image ba1a27ee-dd34-4cff-9f6f-45fe58c996dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created reservations ['57071283-69b5-4e0a-8a42-bfe8a70cb5ab', 'a977c0a0-47fe-4f2c-b3af-2f8acf256731', '0d10ba1e-2c1d-49a4-82b1-fcbd1d8aee53', '4f8c3ba2-34c6-4d52-889c-ef9b94f5eb1f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:54 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:54 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:54 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca 1073741824" returned: 0 in 0.696s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:54 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca Sep 02 00:02:54 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:55 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.317s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Deleted volume successfully. Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19133859-6a3f-4ac5-ac4c-22bf2cb07804 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-8386942f-3b27-4edb-b4bf-0f9729be7e89-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:55 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.930s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Creating offline snapshot 04c13da8-358c-4556-b191-c2010a55a1e4 of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00843df0-f0c2-4d89-9198-d7b61eaaf37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23af3b84-d51c-48bb-8321-f904c73540ca', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac871637-cbd8-4f50-a51e-bfb063c4afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c57ca81-fdc7-4c18-b43e-29739b8e4573]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Volume volume-23af3b84-d51c-48bb-8321-f904c73540ca (23af3b84-d51c-48bb-8321-f904c73540ca): created successfully Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac871637-cbd8-4f50-a51e-bfb063c4afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Flow 'volume_create_manager' (e5e7d718-e1bb-43f5-84c8-71307dad3d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:02:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e481b2c6-3159-4696-8c86-31d93befc50c tempest-TestInstancesWithCinderVolumes-2010248593 None] Created volume successfully. Sep 02 00:02:55 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:02:55 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-0d9d3139-8136-459b-b975-02b3a5c57404-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-0d9d3139-8136-459b-b975-02b3a5c57404-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-quobyte-0d9d3139-8136-459b-b975-02b3a5c57404" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-0d9d3139-8136-459b-b975-02b3a5c57404" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4190d64d-8950-49e0-8f5f-7470d5a314f0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:55 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.502s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:02:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:55 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 1G Sep 02 00:02:55 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:55 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404 Sep 02 00:02:55 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:56 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:56 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 1G" returned: 0 in 0.539s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:56 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404 Sep 02 00:02:56 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:56 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 Sep 02 00:02:56 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:56 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-0d9d3139-8136-459b-b975-02b3a5c57404" returned: 0 in 0.301s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-0d9d3139-8136-459b-b975-02b3a5c57404" released by "delete_volume" :: held 0.884s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:56 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:56 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 is being set with open permissions: ugo+rw Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:56 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 Sep 02 00:02:56 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created reservations ['8808a06a-cab7-42e4-af8f-2a5bc3ad6967', '72008790-df21-4342-a285-0cb3ea09169c', '576f5981-869c-4af7-88fb-b06b3f7aaa50', '2f8d9e89-7d84-41d4-a97e-d7cdcb74f518'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:56 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:56 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-be066a08-fe1d-48ac-8e60-16608c2031b7-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-be066a08-fe1d-48ac-8e60-16608c2031b7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:57 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-quobyte-be066a08-fe1d-48ac-8e60-16608c2031b7" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-be066a08-fe1d-48ac-8e60-16608c2031b7" acquired by "delete_volume" :: waited 0.071s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6457f9-4bb7-40a7-8f0d-3be2961798b2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-81969f95-f1f0-434b-8f2c-0e7ab4d01879 tempest-SnapshotsActionsTest-454500508 None] Create snapshot completed successfully Sep 02 00:02:57 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.419s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Deleted volume successfully. Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1e9670a-9a60-4686-a1c7-f459ccc1c9a9 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-0d9d3139-8136-459b-b975-02b3a5c57404-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:57 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7 Sep 02 00:02:57 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-04c13da8-358c-4556-b191-c2010a55a1e4-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-04c13da8-358c-4556-b191-c2010a55a1e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-quobyte-04c13da8-358c-4556-b191-c2010a55a1e4" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:57 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7" returned: 0 in 0.497s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-04c13da8-358c-4556-b191-c2010a55a1e4" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Deleting offline snapshot 04c13da8-358c-4556-b191-c2010a55a1e4 of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:02:57 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7 Sep 02 00:02:57 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] snapshot_file for this snap is: volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[547a2e90-3e90-4aa6-855a-8c8877c5d8a1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:57 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 Sep 02 00:02:57 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:58 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be066a08-fe1d-48ac-8e60-16608c2031b7" returned: 0 in 0.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-be066a08-fe1d-48ac-8e60-16608c2031b7" released by "delete_volume" :: held 0.913s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created reservations ['e84afc71-0278-4e1f-bd2b-6c047bd299f0', '58da35e8-d130-4fc6-b7cd-41a9573e1a0f', 'a5847d5b-0149-4bce-b6fa-00afd012f3f8', 'a64a3c29-df01-45d5-898f-bd05fe6d7ced'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:58 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4" returned: 0 in 0.437s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d79810-cc37-433f-babb-7c2eeacef0f9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:58 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:02:58 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:58 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:02:58 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:58 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:02:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Deleted volume successfully. Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9d634b-cfb8-4b4c-bbc2-4f7dd0d60aa0 tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-be066a08-fe1d-48ac-8e60-16608c2031b7-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:58 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.437s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:02:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:58 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 Sep 02 00:02:58 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:59 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:59 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4 Sep 02 00:02:59 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-be6897d1-79bf-4eb4-9b5c-dab0b87fd764-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-be6897d1-79bf-4eb4-9b5c-dab0b87fd764-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:59 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "cinder-quobyte-be6897d1-79bf-4eb4-9b5c-dab0b87fd764" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.04c13da8-358c-4556-b191-c2010a55a1e4" returned: 0 in 0.273s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-04c13da8-358c-4556-b191-c2010a55a1e4" released by "_delete_snapshot" :: held 1.663s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-be6897d1-79bf-4eb4-9b5c-dab0b87fd764" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" released by "delete_snapshot" :: held 1.733s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d83071a-b8fd-4331-9655-23c4534c59b8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Created reservations ['7e3fa102-b560-4bee-a728-efdb4d103caa', 'a2eb2a08-2889-4182-b953-c1845b29e4e1', '9fcd627d-66e1-4f08-8919-1881a7693ae0', 'b81763a5-3fa8-4042-be05-5eddaf54be10'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:02:59 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 Sep 02 00:02:59 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Delete snapshot completed successfully. Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7772aaa-7cde-4894-b8b0-4367fea2b51c tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-04c13da8-358c-4556-b191-c2010a55a1e4-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD, size 20.69 MB, duration 4.99 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:02:59 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Image download 20.69 MB at 4.14 MB/s Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5b00b8-0b8c-4014-b1d2-a7fd91403a9c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:59 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD Sep 02 00:02:59 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:02:59 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:02:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:02:59 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764 Sep 02 00:02:59 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:00 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Temporary image ba1a27ee-dd34-4cff-9f6f-45fe58c996dd is fetched for user 862d5080ccf04c24b7282dafa330d106. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:03:00 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-be6897d1-79bf-4eb4-9b5c-dab0b87fd764" returned: 0 in 0.267s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-quobyte-be6897d1-79bf-4eb4-9b5c-dab0b87fd764" released by "delete_volume" :: held 0.704s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Creating offline snapshot e0945800-88f5-4d30-8636-02d9e94c4995 of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ddb4ba-bc31-48b8-bbfd-0e9378132b48]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9504bce-9296-479c-b228-cf0019af1c70]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Created reservations ['3540bc45-0b96-4494-aede-148a7e7c9192', '7f727917-e9c7-45de-ad8b-f99bd63e94c3', 'f5eb824a-066e-4ab3-8c46-b865b4d80805', '6a584dd2-af31-4f13-8075-57cf67c601fa'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:00 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD Sep 02 00:03:00 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:00 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:03:00 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:00 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:03:00 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:00 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:00 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.287s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:03:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Deleted volume successfully. Sep 02 00:03:00 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90775967-4da4-481e-ad80-bc7146f755bc tempest-CreateVolumesFromSourceVolumeTest-358541277 None] Lock "cinder-be6897d1-79bf-4eb4-9b5c-dab0b87fd764-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:00 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 1G Sep 02 00:03:00 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:01 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 1G" returned: 0 in 0.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:01 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 Sep 02 00:03:01 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:01 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995" returned: 0 in 0.315s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:01 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 is being set with open permissions: ugo+rw Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:01 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 Sep 02 00:03:01 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:01 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995" returned: 0 in 0.269s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.574s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1110596730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872cae90-3e88-414e-9b20-c8f572e21e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4a8f52e6a247a289159bd0ac1096a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:02:54Z,use_quota=True,user_id='862d5080ccf04c24b7282dafa330d106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b19a07f-5941-404e-b49e-832ec645ed4e),volume_type_id=4b19a07f-5941-404e-b49e-832ec645ed4e)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Creating volume 872cae90-3e88-414e-9b20-c8f572e21e92 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:03:01 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:03:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:01 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 1073741824 Sep 02 00:03:01 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-71b597a3-8bf0-4219-bba6-5be52e6133ec tempest-SnapshotsActionsTest-454500508 None] Create snapshot completed successfully Sep 02 00:03:02 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 1073741824" returned: 0 in 0.477s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:02 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 Sep 02 00:03:02 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-e0945800-88f5-4d30-8636-02d9e94c4995-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-e0945800-88f5-4d30-8636-02d9e94c4995-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-quobyte-e0945800-88f5-4d30-8636-02d9e94c4995" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-e0945800-88f5-4d30-8636-02d9e94c4995" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Deleting offline snapshot e0945800-88f5-4d30-8636-02d9e94c4995 of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] snapshot_file for this snap is: volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[437f7d02-b682-4f6c-b157-628428a9c549]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:02 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92" returned: 0 in 0.292s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Attempting download of ba1a27ee-dd34-4cff-9f6f-45fe58c996dd ((None, [{'url': 'file:///opt/stack/data/glance/images/ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'metadata': {}}])) to volume 872cae90-3e88-414e-9b20-c8f572e21e92. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:03:02 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 Sep 02 00:03:02 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6199a3-db14-4773-bd88-dc7f096175b3]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_1fybe8ew {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:02 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_1fybe8ew Sep 02 00:03:02 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:02 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995" returned: 0 in 0.437s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb0509a-1b79-431f-994f-1e469d078551]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:03 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_1fybe8ew" returned: 0 in 0.380s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_1fybe8ew {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:03 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:03:03 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:03 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_1fybe8ew Sep 02 00:03:03 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:03 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.398s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:03 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 Sep 02 00:03:03 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:03 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_1fybe8ew" returned: 1 in 0.381s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_1fybe8ew' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[06782661-ff11-460f-ac40-40e8e2ae5f11]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:03 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD Sep 02 00:03:03 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:03 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995" returned: 0 in 0.469s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:03:03 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995 Sep 02 00:03:03 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Flow 'volume_create_manager' (7313eb19-a7a0-44e7-8100-df8e2a5b7b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c49f54-3964-4c99-9217-cdca72b3f145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:03 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] ba1a27ee-dd34-4cff-9f6f-45fe58c996dd was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c49f54-3964-4c99-9217-cdca72b3f145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-971907204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e73ada-34ed-41be-b2a7-410b45a96658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb5e124665724447bb80e880e34febde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:04Z,use_quota=True,user_id='bafcc6c439b747d9ba178fffd3f5f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:03 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 Sep 02 00:03:03 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30482a4b-5547-4e66-9c6c-a9854c614c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30482a4b-5547-4e66-9c6c-a9854c614c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2aafb9c-e8fd-4ded-a095-041c26aa1a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2aafb9c-e8fd-4ded-a095-041c26aa1a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e73ada-34ed-41be-b2a7-410b45a96658', 'volume_name': 'volume-77e73ada-34ed-41be-b2a7-410b45a96658', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0848d0e-0cfe-4aea-abdb-44035f234786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0848d0e-0cfe-4aea-abdb-44035f234786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3ec561-f5fd-4239-99e3-719d9cb1be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Volume 77e73ada-34ed-41be-b2a7-410b45a96658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e73ada-34ed-41be-b2a7-410b45a96658', 'volume_size': 1} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-971907204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e73ada-34ed-41be-b2a7-410b45a96658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb5e124665724447bb80e880e34febde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:04Z,use_quota=True,user_id='bafcc6c439b747d9ba178fffd3f5f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Creating volume 77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:03:03 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:03:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:03 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 1073741824 Sep 02 00:03:03 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:04 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.e0945800-88f5-4d30-8636-02d9e94c4995" returned: 0 in 0.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-e0945800-88f5-4d30-8636-02d9e94c4995" released by "_delete_snapshot" :: held 1.723s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" released by "delete_snapshot" :: held 1.748s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Created reservations ['e7dfa2f0-0fa2-4a9a-932d-abc268b52e37', 'd13822b7-6f33-41c5-94a2-3fca670b7416', '17861431-09b6-4b57-bdbc-6cce630673b4', '7cc6e30c-72d1-47ff-a307-35d42977167c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Delete snapshot completed successfully. Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6905eefe-b8ea-4ec1-bce8-f3bd03bac851 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-e0945800-88f5-4d30-8636-02d9e94c4995-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:04 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 1073741824" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:04 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 Sep 02 00:03:04 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:04 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658" returned: 0 in 0.257s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3ec561-f5fd-4239-99e3-719d9cb1be84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e73ada-34ed-41be-b2a7-410b45a96658', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1f4784-46e5-4fae-bbff-42270e9ac15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Volume volume-77e73ada-34ed-41be-b2a7-410b45a96658 (77e73ada-34ed-41be-b2a7-410b45a96658): created successfully Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1f4784-46e5-4fae-bbff-42270e9ac15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Flow 'volume_create_manager' (7313eb19-a7a0-44e7-8100-df8e2a5b7b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2138ed5a-0a8d-45e0-a7ca-c9dc4e84bb30 tempest-VolumeDependencyTests-2050221400 None] Created volume successfully. Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Creating offline snapshot d8d1b656-7d8b-4b7e-9dd6-067c7667b91a of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1426ee-c296-4358-92aa-41d045692fce]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:05 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:03:05 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:05 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:05 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a 1G Sep 02 00:03:05 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:05 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92" returned: 0 in 1.907s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:05 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ba1a27ee-dd34-4cff-9f6f-45fe58c996dd_6_e2x19vdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:03:05 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Converted 112.00 MB image at 58.69 MB/s Sep 02 00:03:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:05 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 1G Sep 02 00:03:05 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:05 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a 1G" returned: 0 in 0.639s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:06 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a Sep 02 00:03:06 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:06 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 1G" returned: 0 in 0.410s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Downloaded image ba1a27ee-dd34-4cff-9f6f-45fe58c996dd ((None, [{'url': 'file:///opt/stack/data/glance/images/ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'metadata': {}}])) to volume 872cae90-3e88-414e-9b20-c8f572e21e92 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Temporary image ba1a27ee-dd34-4cff-9f6f-45fe58c996dd for user 862d5080ccf04c24b7282dafa330d106 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Marking volume 872cae90-3e88-414e-9b20-c8f572e21e92 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Copying metadata from image ba1a27ee-dd34-4cff-9f6f-45fe58c996dd to 872cae90-3e88-414e-9b20-c8f572e21e92. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Creating volume glance metadata for volume 872cae90-3e88-414e-9b20-c8f572e21e92 backed by image ba1a27ee-dd34-4cff-9f6f-45fe58c996dd with: {'image_id': 'ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'image_name': 'tempest-scenario-img--165406024', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7756e76-b232-4618-a3f6-b4de136af0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872cae90-3e88-414e-9b20-c8f572e21e92', 'volume_size': 1, 'image_id': 'ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--165406024', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d4a8f52e6a247a289159bd0ac1096a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba1a27ee-dd34-4cff-9f6f-45fe58c996dd', 'created_at': datetime.datetime(2026, 9, 1, 22, 2, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 2, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba1a27ee-dd34-4cff-9f6f-45fe58c996dd/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5ccd8e-ba37-4b43-92bf-cb9d3cde0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Volume volume-872cae90-3e88-414e-9b20-c8f572e21e92 (872cae90-3e88-414e-9b20-c8f572e21e92): created successfully Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5ccd8e-ba37-4b43-92bf-cb9d3cde0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Flow 'volume_create_manager' (5e1d69de-0f2d-4250-b0e3-961404d5c2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:06 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a" returned: 0 in 0.331s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:06 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a is being set with open permissions: ugo+rw Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bec460d5-860d-4e59-9532-1acf04ecbfad tempest-TestInstancesWithCinderVolumes-2010248593 None] Created volume successfully. Sep 02 00:03:06 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a Sep 02 00:03:06 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:06 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:03:06 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:06 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a" returned: 0 in 0.244s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.733s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.482s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Creating offline snapshot 09303579-dd76-44db-bbda-dbc42b309178 of volume 77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:03:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-593c26a8-9c79-4b89-a413-2afd027ad425 tempest-SnapshotsActionsTest-454500508 None] Create snapshot completed successfully Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ea469-9dc8-4fed-b9ba-37509c21ff94]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:06 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:06 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 Sep 02 00:03:06 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.260s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:03:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:03:07 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-d8d1b656-7d8b-4b7e-9dd6-067c7667b91a-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-d8d1b656-7d8b-4b7e-9dd6-067c7667b91a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:07 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 1G Sep 02 00:03:07 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-quobyte-d8d1b656-7d8b-4b7e-9dd6-067c7667b91a" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-d8d1b656-7d8b-4b7e-9dd6-067c7667b91a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Deleting offline snapshot d8d1b656-7d8b-4b7e-9dd6-067c7667b91a of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] snapshot_file for this snap is: volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca961830-7d8f-4a84-b6eb-bf015422e997]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:07 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a Sep 02 00:03:07 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:07 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 1G" returned: 0 in 0.500s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e73ada-34ed-41be-b2a7-410b45a96658 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:07 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a" returned: 0 in 0.391s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:07 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e73ada-34ed-41be-b2a7-410b45a96658 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 Sep 02 00:03:07 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[732c0b00-1294-4264-9e0c-f973b408cb80]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:07 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:03:07 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:07 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e73ada-34ed-41be-b2a7-410b45a96658 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178" returned: 0 in 0.329s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:07 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 is being set with open permissions: ugo+rw Sep 02 00:03:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:07 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 Sep 02 00:03:07 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:08 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:08 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a Sep 02 00:03:08 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:08 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:08 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.info Sep 02 00:03:08 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:08 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a" returned: 0 in 0.484s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:08 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.info" returned: 0 in 0.328s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:08 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.info is being set with open permissions: ugo+rw Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:08 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a Sep 02 00:03:08 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:08 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.info Sep 02 00:03:08 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:08 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.d8d1b656-7d8b-4b7e-9dd6-067c7667b91a" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:08 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.info" returned: 0 in 0.303s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-d8d1b656-7d8b-4b7e-9dd6-067c7667b91a" released by "_delete_snapshot" :: held 1.732s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" released by "delete_snapshot" :: held 1.763s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0f5b5e4d-2a01-4197-a3ed-8ba169ce0311 tempest-VolumeDependencyTests-2050221400 None] Create snapshot completed successfully Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Created reservations ['11b941fb-bcb3-4981-8b66-0bab88cc775d', '5215a746-60d7-43c7-a73d-4a25c830aeb6', '3c0a3020-c9c2-4432-9bc1-36d3ca87a1c3', '839c149d-c4b9-4c65-90b5-82dda42fbb8c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Delete snapshot completed successfully. Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f0dae83-ca61-4374-b46b-c2ea2be02324 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-d8d1b656-7d8b-4b7e-9dd6-067c7667b91a-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Flow 'volume_create_manager' (061b9a15-0aff-46ea-a1d2-eb41550cdc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805ffa7b-c4a6-4937-a8e4-892a965214cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805ffa7b-c4a6-4937-a8e4-892a965214cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1280965663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32d279a-bada-4267-90f0-7c8f24751180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf1af1ef8774407bbd17d9341499e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:10Z,use_quota=True,user_id='162912728b4e499b81b5bfe82d5dfa79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d2661e-db89-41b0-b1b8-106d00736630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d2661e-db89-41b0-b1b8-106d00736630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855a7b0d-b0fb-41c2-bb6b-f3b251c6b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855a7b0d-b0fb-41c2-bb6b-f3b251c6b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32d279a-bada-4267-90f0-7c8f24751180', 'volume_name': 'volume-a32d279a-bada-4267-90f0-7c8f24751180', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d90bb45-9ffd-4820-9782-69fc30f6c03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d90bb45-9ffd-4820-9782-69fc30f6c03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01c99c6-b8d9-446d-91c4-c373697072a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Volume a32d279a-bada-4267-90f0-7c8f24751180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32d279a-bada-4267-90f0-7c8f24751180', 'volume_size': 1} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1280965663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32d279a-bada-4267-90f0-7c8f24751180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf1af1ef8774407bbd17d9341499e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:10Z,use_quota=True,user_id='162912728b4e499b81b5bfe82d5dfa79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Creating volume a32d279a-bada-4267-90f0-7c8f24751180 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:03:09 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:03:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:10 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180 1073741824 Sep 02 00:03:10 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Flow 'volume_create_manager' (fe0a4569-e079-43f2-9166-692e6252fb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bebbcd2-420c-4cff-a729-5fb9e326fbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bebbcd2-420c-4cff-a729-5fb9e326fbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1808988586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c1d3c9-e09c-46e7-ba18-20f0c1e4f547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb5e124665724447bb80e880e34febde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=09303579-dd76-44db-bbda-dbc42b309178,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:10Z,use_quota=True,user_id='bafcc6c439b747d9ba178fffd3f5f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb15dca4-8ed3-421b-bdb3-5f1fe247a4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb15dca4-8ed3-421b-bdb3-5f1fe247a4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161028ed-39e9-4397-976b-982ff5adf347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161028ed-39e9-4397-976b-982ff5adf347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84c1d3c9-e09c-46e7-ba18-20f0c1e4f547', 'volume_name': 'volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547', 'volume_size': 1, 'snapshot_id': '09303579-dd76-44db-bbda-dbc42b309178'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d863031-b5ba-40a5-9b15-02b41c75c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d863031-b5ba-40a5-9b15-02b41c75c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7f21ab-b9b5-422d-9ea1-a1fd1d9ba7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Volume 84c1d3c9-e09c-46e7-ba18-20f0c1e4f547: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547', 'volume_size': 1, 'snapshot_id': '09303579-dd76-44db-bbda-dbc42b309178'} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-972c15ba-3d40-4b77-8452-3a358ffa26cd req-7bd2299f-eecf-4a6e-be3e-defacebef534 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:10 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180 1073741824" returned: 0 in 0.550s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:10 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180 Sep 02 00:03:10 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:10 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.694s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01c99c6-b8d9-446d-91c4-c373697072a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32d279a-bada-4267-90f0-7c8f24751180', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8159e915-c775-4a94-a9d1-a643069e5a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Creating offline snapshot 74f89b07-ec15-48f8-9c8f-9ccb280f9b53 of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:03:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Volume volume-a32d279a-bada-4267-90f0-7c8f24751180 (a32d279a-bada-4267-90f0-7c8f24751180): created successfully Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8159e915-c775-4a94-a9d1-a643069e5a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Flow 'volume_create_manager' (061b9a15-0aff-46ea-a1d2-eb41550cdc52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f31c0b7-896e-4b73-9b15-5a3e11fda869]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-36f52cde-0409-44e5-8350-0ae50a0b7838 tempest-AttachVolumeNegativeTest-328114835 None] Created volume successfully. Sep 02 00:03:11 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:03:11 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:11 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.408s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:11 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 1G Sep 02 00:03:11 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:11 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 1G" returned: 0 in 0.530s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:11 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 Sep 02 00:03:11 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:12 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53" returned: 0 in 0.340s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:12 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 is being set with open permissions: ugo+rw Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:12 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 Sep 02 00:03:12 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:12 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53" returned: 0 in 0.264s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.680s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.253s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "cinder-quobyte-09303579-dd76-44db-bbda-dbc42b309178-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-09303579-dd76-44db-bbda-dbc42b309178-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Creating volume 84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 from snapshot 09303579-dd76-44db-bbda-dbc42b309178 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "cinder-quobyte-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-80adb8e9-39f2-4866-86a5-5fe550f34f30 tempest-SnapshotsActionsTest-454500508 None] Create snapshot completed successfully Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-1948520a-e8ff-437a-bea0-46c38eeafc46 req-fb30338a-5eb8-473c-96c9-2e3d1ba32ac5 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] snapshot: 09303579-dd76-44db-bbda-dbc42b309178, volume: 84c1d3c9-e09c-46e7-ba18-20f0c1e4f547, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5e3381-b171-408e-b35a-6e9daab642ac]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:12 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 Sep 02 00:03:12 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:13 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e73ada-34ed-41be-b2a7-410b45a96658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a03285-feee-45a7-ba45-9b7af40771a6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:13 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 Sep 02 00:03:13 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:13 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:03:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:03:13 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:03:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:13 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 Sep 02 00:03:13 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:17 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" returned: 0 in 4.070s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:03:17 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Converted 1024.00 MB image at 251.49 MB/s Sep 02 00:03:17 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 is being set with open permissions: ugo+rw Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:17 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 Sep 02 00:03:17 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:17 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" returned: 0 in 0.242s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" released by "_copy_volume_from_snapshot" :: held 5.133s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-09303579-dd76-44db-bbda-dbc42b309178-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" released by "_create_volume_from_snapshot" :: held 5.209s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.256s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-972c15ba-3d40-4b77-8452-3a358ffa26cd req-7bd2299f-eecf-4a6e-be3e-defacebef534 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.417s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-972c15ba-3d40-4b77-8452-3a358ffa26cd req-7bd2299f-eecf-4a6e-be3e-defacebef534 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-1948520a-e8ff-437a-bea0-46c38eeafc46 req-fb30338a-5eb8-473c-96c9-2e3d1ba32ac5 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.203s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7f21ab-b9b5-422d-9ea1-a1fd1d9ba7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547', 'volume_size': 1, 'snapshot_id': '09303579-dd76-44db-bbda-dbc42b309178'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fed2656-38b5-4577-ae3f-f20e1c04efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-1948520a-e8ff-437a-bea0-46c38eeafc46 req-fb30338a-5eb8-473c-96c9-2e3d1ba32ac5 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Volume volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 (84c1d3c9-e09c-46e7-ba18-20f0c1e4f547): created successfully Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fed2656-38b5-4577-ae3f-f20e1c04efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Flow 'volume_create_manager' (fe0a4569-e079-43f2-9166-692e6252fb6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-972c15ba-3d40-4b77-8452-3a358ffa26cd req-7bd2299f-eecf-4a6e-be3e-defacebef534 tempest-TestInstancesWithCinderVolumes-2010248593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-872cae90-3e88-414e-9b20-c8f572e21e92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a80fcb6d-22eb-4b39-a61d-1624aa1a35d5', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:03:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f74ba42d-eb14-4ae2-a3fa-2deebb072a3f tempest-VolumeDependencyTests-2050221400 None] Created volume successfully. Sep 02 00:03:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-1948520a-e8ff-437a-bea0-46c38eeafc46 req-fb30338a-5eb8-473c-96c9-2e3d1ba32ac5 tempest-AttachVolumeNegativeTest-328114835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-a32d279a-bada-4267-90f0-7c8f24751180', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af705af7-1a0d-4f62-9ef1-014cd8af3439', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:03:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-972c15ba-3d40-4b77-8452-3a358ffa26cd req-7bd2299f-eecf-4a6e-be3e-defacebef534 tempest-TestInstancesWithCinderVolumes-2010248593 None] attachment_update completed successfully. Sep 02 00:03:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-1948520a-e8ff-437a-bea0-46c38eeafc46 req-fb30338a-5eb8-473c-96c9-2e3d1ba32ac5 tempest-AttachVolumeNegativeTest-328114835 None] attachment_update completed successfully. Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "cinder-09303579-dd76-44db-bbda-dbc42b309178-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-09303579-dd76-44db-bbda-dbc42b309178-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "cinder-quobyte-77e73ada-34ed-41be-b2a7-410b45a96658" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-74f89b07-ec15-48f8-9c8f-9ccb280f9b53-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-77e73ada-34ed-41be-b2a7-410b45a96658" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "cinder-quobyte-09303579-dd76-44db-bbda-dbc42b309178" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-74f89b07-ec15-48f8-9c8f-9ccb280f9b53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-09303579-dd76-44db-bbda-dbc42b309178" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Deleting offline snapshot 09303579-dd76-44db-bbda-dbc42b309178 of volume 77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] snapshot_file for this snap is: volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Acquiring lock "cinder-quobyte-74f89b07-ec15-48f8-9c8f-9ccb280f9b53" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4a7288-95aa-4c72-8ffc-4c5a5ee6619e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-74f89b07-ec15-48f8-9c8f-9ccb280f9b53" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Deleting offline snapshot 74f89b07-ec15-48f8-9c8f-9ccb280f9b53 of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] snapshot_file for this snap is: volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a51970-e964-4643-928f-468ec62c4b4f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:18 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 Sep 02 00:03:18 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:18 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 Sep 02 00:03:18 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:19 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178" returned: 0 in 0.705s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e73ada-34ed-41be-b2a7-410b45a96658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:19 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53" returned: 0 in 0.696s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f427ef-042b-4dab-a912-313abb79a9cb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b4751-e046-44d9-b2e5-021a56329598]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:19 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 Sep 02 00:03:19 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:19 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:03:19 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:20 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.755s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:20 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 Sep 02 00:03:20 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:20 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658" returned: 0 in 0.899s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:20 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 Sep 02 00:03:20 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:20 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53" returned: 0 in 0.519s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:20 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53 Sep 02 00:03:20 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:20 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178" returned: 0 in 0.503s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:20 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178 Sep 02 00:03:20 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:21 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.74f89b07-ec15-48f8-9c8f-9ccb280f9b53" returned: 0 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-74f89b07-ec15-48f8-9c8f-9ccb280f9b53" released by "_delete_snapshot" :: held 2.539s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" released by "delete_snapshot" :: held 2.602s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:21 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658.09303579-dd76-44db-bbda-dbc42b309178" returned: 0 in 0.482s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Created reservations ['bd6ff072-dd24-4f24-a14f-af8a6fe67087', '45494cda-853f-468e-a605-fcd4c5fbd0a6', '3d1e8204-3214-4ad4-874d-c4c87cce6162', '80c17359-ed76-44d9-af41-7e47d388be42'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-09303579-dd76-44db-bbda-dbc42b309178" released by "_delete_snapshot" :: held 2.868s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-77e73ada-34ed-41be-b2a7-410b45a96658" released by "delete_snapshot" :: held 2.925s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Delete snapshot completed successfully. Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a437600b-ef7a-4ef5-b02f-5af34002bd50 tempest-SnapshotsActionsTest-1062975004 None] Lock "cinder-74f89b07-ec15-48f8-9c8f-9ccb280f9b53-delete_snapshot" released by "delete_snapshot" :: held 3.042s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Created reservations ['b33d3e77-e02e-4c99-ad91-832e4cc60512', '8a4e89a3-cf1d-4b29-9416-3094b7a3e450', 'f0a24523-bfa4-49d2-b277-28502b80509f', 'ca749684-a888-4752-add4-f27563894a13'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Delete snapshot completed successfully. Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-759e8393-b687-4da5-b363-f65412d1377e tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-09303579-dd76-44db-bbda-dbc42b309178-delete_snapshot" released by "delete_snapshot" :: held 3.367s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "cinder-77e73ada-34ed-41be-b2a7-410b45a96658-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-77e73ada-34ed-41be-b2a7-410b45a96658-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "cinder-quobyte-77e73ada-34ed-41be-b2a7-410b45a96658" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-77e73ada-34ed-41be-b2a7-410b45a96658" acquired by "delete_volume" :: waited 0.045s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[351af45b-376e-4661-a3eb-af2a512844d7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:22 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 Sep 02 00:03:22 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:22 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-2ef64ad6-d141-4c77-a391-442c2da06975 req-9937c447-6e80-47cb-b26f-f7e083549a3a tempest-AttachVolumeNegativeTest-328114835 None] Terminate volume connection completed successfully. Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-2ef64ad6-d141-4c77-a391-442c2da06975 req-9937c447-6e80-47cb-b26f-f7e083549a3a tempest-AttachVolumeNegativeTest-328114835 None] Deleting attachment af705af7-1a0d-4f62-9ef1-014cd8af3439. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658" returned: 0 in 0.571s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:22 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658 Sep 02 00:03:22 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "cinder-ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "cinder-quobyte-ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-quobyte-ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Deleting offline snapshot ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 of volume a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] snapshot_file for this snap is: volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11979e8-0a48-4f55-9278-48b131276af8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:23 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:03:23 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:23 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-77e73ada-34ed-41be-b2a7-410b45a96658" returned: 0 in 0.604s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-77e73ada-34ed-41be-b2a7-410b45a96658" released by "delete_volume" :: held 1.282s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Created reservations ['f44579ab-a884-43f9-9b6e-be0ff76da83b', 'df806da7-ace2-4951-a326-03aae523bf27', 'd0eac0d7-7a42-4901-a502-215edee022cf', '0cc4954a-bf6a-49c5-a3b3-293ecee809b3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:23 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:03:23 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:23 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.544s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae71e2b4-6c5b-44b7-a25e-4b91f06cbc3f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:23 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:03:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Deleted volume successfully. Sep 02 00:03:23 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 Sep 02 00:03:23 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b46c6f37-4747-4ac2-a8c8-1c70244982fa tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-77e73ada-34ed-41be-b2a7-410b45a96658-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "cinder-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:24 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6" returned: 0 in 0.700s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:24 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:03:24 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "cinder-quobyte-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7310d4-7eb5-4ca1-a2cf-6449b3124bd7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:24 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 Sep 02 00:03:24 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:25 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 1.084s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:25 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196 Sep 02 00:03:25 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:25 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" returned: 0 in 1.041s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:25 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547 Sep 02 00:03:25 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:25 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6.ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" returned: 0 in 0.499s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:26 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-quobyte-ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196" released by "_delete_snapshot" :: held 3.068s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" returned: 0 in 0.429s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" released by "delete_snapshot" :: held 3.128s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-quobyte-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547" released by "delete_volume" :: held 1.580s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Created reservations ['d9ba5b05-50d3-4b62-ae23-371314fa0dda', '2cb7ba00-908c-4a77-a732-974f39592e23', '0cf24683-9136-4008-800f-abb42998dca8', 'da454694-5874-4250-be75-bef36d5cc59b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Created reservations ['6a6da777-c08c-48db-82de-447f329cf469', '4fe30fee-830c-43ce-962d-315219093468', '3d41532d-3541-47ae-b1ff-a51b82b6aa0f', '26f02c15-0ed3-491e-b39e-5de9bfeea949'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:26 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:03:26 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Delete snapshot completed successfully. Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b9c8cb7-2d9d-4a02-9afd-636ce37c737d tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-ddb0b3d9-218c-4b2a-82cd-8dbffc3d8196-delete_snapshot" released by "delete_snapshot" :: held 3.656s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:26 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.427s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:03:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Deleted volume successfully. Sep 02 00:03:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ff56bddf-e9ce-4837-bf69-56688176bf51 tempest-VolumeDependencyTests-2050221400 None] Lock "cinder-84c1d3c9-e09c-46e7-ba18-20f0c1e4f547-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "cinder-a328b04d-83c9-4484-8ee4-567d2eba8aa6-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-a328b04d-83c9-4484-8ee4-567d2eba8aa6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" acquired by "delete_volume" :: waited 0.048s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b378729b-dcc2-45eb-a125-1340055c764b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:27 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 Sep 02 00:03:27 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:28 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6" returned: 0 in 0.676s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:28 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6 Sep 02 00:03:28 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:28 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a328b04d-83c9-4484-8ee4-567d2eba8aa6" returned: 0 in 0.480s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-quobyte-a328b04d-83c9-4484-8ee4-567d2eba8aa6" released by "delete_volume" :: held 1.303s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=137,cinder:SELECT=134,cinder:DELETE=11,cinder:INSERT=45 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:03:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Created reservations ['5929cde5-ef2f-4165-9d2d-28c673f389b0', '677a739c-9291-4600-ae20-90de793240ed', 'a1a7ae98-1e9e-40f9-b26f-2449523cac1d', '9a403ab3-b91d-46d5-b446-d9163fc36740'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:29 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:03:29 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:29 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.341s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:03:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Deleted volume successfully. Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=140,cinder:UPDATE=164,cinder:INSERT=38,cinder:DELETE=17 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:03:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0a134933-4b15-4941-ab0e-5f56e3af604e tempest-SnapshotsActionsTest-454500508 None] Lock "cinder-a328b04d-83c9-4484-8ee4-567d2eba8aa6-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:39 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Flow 'volume_create_manager' (742ab41b-348d-4320-9c39-a5468521fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5920a751-16e2-42e0-b593-c05b705d765f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5920a751-16e2-42e0-b593-c05b705d765f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356958974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec11632-b122-4147-bb99-841e4c776ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f780df9986564f6680b177bf0a7b81a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:50Z,use_quota=True,user_id='e1f3643522f94273957dced8a2014c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422f9194-5731-4930-a598-bf83c7644a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422f9194-5731-4930-a598-bf83c7644a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d50ea9b-410e-4236-9ac7-fab3c74b9cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d50ea9b-410e-4236-9ac7-fab3c74b9cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec11632-b122-4147-bb99-841e4c776ab9', 'volume_name': 'volume-8ec11632-b122-4147-bb99-841e4c776ab9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12d59b9-c232-4290-8211-209373b23cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12d59b9-c232-4290-8211-209373b23cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a69662-72f9-4a1c-a2e2-d35cb5c6d2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Volume 8ec11632-b122-4147-bb99-841e4c776ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec11632-b122-4147-bb99-841e4c776ab9', 'volume_size': 1} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356958974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec11632-b122-4147-bb99-841e4c776ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f780df9986564f6680b177bf0a7b81a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:50Z,use_quota=True,user_id='e1f3643522f94273957dced8a2014c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Creating volume 8ec11632-b122-4147-bb99-841e4c776ab9 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:03:49 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:03:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:49 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9 1073741824 Sep 02 00:03:49 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:50 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9 1073741824" returned: 0 in 0.622s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-57220166-1a2c-41a7-bca0-c9407b807081 req-8064a765-3002-42d1-87f8-d5a76ab6d438 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:50 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9 Sep 02 00:03:50 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:50 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9" returned: 0 in 0.312s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-57220166-1a2c-41a7-bca0-c9407b807081 req-8064a765-3002-42d1-87f8-d5a76ab6d438 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.321s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a69662-72f9-4a1c-a2e2-d35cb5c6d2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec11632-b122-4147-bb99-841e4c776ab9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376b5e1e-6a65-4778-9ff7-67c7cf8a9b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-57220166-1a2c-41a7-bca0-c9407b807081 req-8064a765-3002-42d1-87f8-d5a76ab6d438 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Volume volume-8ec11632-b122-4147-bb99-841e4c776ab9 (8ec11632-b122-4147-bb99-841e4c776ab9): created successfully Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376b5e1e-6a65-4778-9ff7-67c7cf8a9b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Flow 'volume_create_manager' (742ab41b-348d-4320-9c39-a5468521fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9b8f76d7-b468-447a-966b-75dbd17c71d6 tempest-ProjectReaderTests-1683439344 None] Created volume successfully. Sep 02 00:03:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-57220166-1a2c-41a7-bca0-c9407b807081 req-8064a765-3002-42d1-87f8-d5a76ab6d438 tempest-TestInstancesWithCinderVolumes-2010248593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81c6483d-7656-409b-b7fa-834f09b64130', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:03:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-57220166-1a2c-41a7-bca0-c9407b807081 req-8064a765-3002-42d1-87f8-d5a76ab6d438 tempest-TestInstancesWithCinderVolumes-2010248593 None] attachment_update completed successfully. Sep 02 00:03:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "cinder-8ec11632-b122-4147-bb99-841e4c776ab9-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-8ec11632-b122-4147-bb99-841e4c776ab9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "cinder-quobyte-8ec11632-b122-4147-bb99-841e4c776ab9" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-quobyte-8ec11632-b122-4147-bb99-841e4c776ab9" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b7bb7c-78ba-4fff-8269-5e291c91b0c4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:52 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9 Sep 02 00:03:52 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:52 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9" returned: 0 in 0.480s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:52 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9 Sep 02 00:03:52 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:53 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ec11632-b122-4147-bb99-841e4c776ab9" returned: 0 in 0.362s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-quobyte-8ec11632-b122-4147-bb99-841e4c776ab9" released by "delete_volume" :: held 0.932s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Created reservations ['4b5a27bc-8310-4f63-8f8f-f4ab1ce285d1', 'c2389d30-5997-4eb4-aa3d-060dc3b85835', '7b89b2e2-76ee-4bf7-bb1a-5d1afa3293d6', '2ace3585-a44a-48cd-ad2d-eebf49718d39'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:53 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:03:53 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:53 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.436s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:03:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Deleted volume successfully. Sep 02 00:03:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9347423-d5b4-45a0-94de-e8b119d77259 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-8ec11632-b122-4147-bb99-841e4c776ab9-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-0380b4ec-3c73-4773-9171-887f356b0842 req-ff8b6278-6cce-4a67-be0c-0172ab225fb7 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-0380b4ec-3c73-4773-9171-887f356b0842 req-ff8b6278-6cce-4a67-be0c-0172ab225fb7 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-0380b4ec-3c73-4773-9171-887f356b0842 req-ff8b6278-6cce-4a67-be0c-0172ab225fb7 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-0380b4ec-3c73-4773-9171-887f356b0842 req-ff8b6278-6cce-4a67-be0c-0172ab225fb7 tempest-TestInstancesWithCinderVolumes-2010248593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-23af3b84-d51c-48bb-8321-f904c73540ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f60e37c-faed-4e0a-9474-946e8ca93c54', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:03:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-0380b4ec-3c73-4773-9171-887f356b0842 req-ff8b6278-6cce-4a67-be0c-0172ab225fb7 tempest-TestInstancesWithCinderVolumes-2010248593 None] attachment_update completed successfully. Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Flow 'volume_create_manager' (8e040304-7de5-4c7f-a831-0fd0d5727c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a23810-50be-49ba-9f51-bfb60ac1c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a23810-50be-49ba-9f51-bfb60ac1c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982116213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87921e0b-244a-4cb2-a840-67181a8466a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f780df9986564f6680b177bf0a7b81a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:55Z,use_quota=True,user_id='e1f3643522f94273957dced8a2014c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd294dc8-3c45-41f5-8f9c-838a869d0fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd294dc8-3c45-41f5-8f9c-838a869d0fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfdb3ae-39ec-43eb-a6dd-89462ec40de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfdb3ae-39ec-43eb-a6dd-89462ec40de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87921e0b-244a-4cb2-a840-67181a8466a2', 'volume_name': 'volume-87921e0b-244a-4cb2-a840-67181a8466a2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cea52d8-383a-4eb4-baa4-1de4cfac9966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cea52d8-383a-4eb4-baa4-1de4cfac9966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d166adb1-b745-4a4b-8d9f-85a5f3e50d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Volume 87921e0b-244a-4cb2-a840-67181a8466a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87921e0b-244a-4cb2-a840-67181a8466a2', 'volume_size': 1} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982116213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87921e0b-244a-4cb2-a840-67181a8466a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f780df9986564f6680b177bf0a7b81a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:55Z,use_quota=True,user_id='e1f3643522f94273957dced8a2014c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Creating volume 87921e0b-244a-4cb2-a840-67181a8466a2 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:03:55 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:55 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2 1073741824 Sep 02 00:03:55 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:55 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2 1073741824" returned: 0 in 0.506s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:56 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2 Sep 02 00:03:56 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:56 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2" returned: 0 in 0.301s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:03:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d166adb1-b745-4a4b-8d9f-85a5f3e50d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87921e0b-244a-4cb2-a840-67181a8466a2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927c1ec8-e134-4e5b-b50f-81605a667e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Volume volume-87921e0b-244a-4cb2-a840-67181a8466a2 (87921e0b-244a-4cb2-a840-67181a8466a2): created successfully Sep 02 00:03:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927c1ec8-e134-4e5b-b50f-81605a667e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Flow 'volume_create_manager' (8e040304-7de5-4c7f-a831-0fd0d5727c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1167d96f-379c-4c16-99b3-a80e6342a184 tempest-ProjectReaderTests-1683439344 None] Created volume successfully. Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Flow 'volume_create_manager' (1c284ff1-303d-40be-a6d6-4b6325105792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85055cee-1c16-4826-9ea1-c20496152ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85055cee-1c16-4826-9ea1-c20496152ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1378503705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35e2cb2e9b046e99f0178394bed038d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:57Z,use_quota=True,user_id='b3364e3f076144c3b29e66b2aec02a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3f11a2-3e37-4b55-9c3d-8d5614b1f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3f11a2-3e37-4b55-9c3d-8d5614b1f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898f4a11-80a6-47ee-afa9-8b15ddfc35ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898f4a11-80a6-47ee-afa9-8b15ddfc35ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8', 'volume_name': 'volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b58095-c241-4ddc-9e43-91f57f7e6fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b58095-c241-4ddc-9e43-91f57f7e6fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de3d80a-bdf4-4b9f-93d5-6522c07a841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:57 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Volume 53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8', 'volume_size': 1} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1378503705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35e2cb2e9b046e99f0178394bed038d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:57Z,use_quota=True,user_id='b3364e3f076144c3b29e66b2aec02a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Creating volume 53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:03:57 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:57 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 1073741824 Sep 02 00:03:57 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "cinder-87921e0b-244a-4cb2-a840-67181a8466a2-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-87921e0b-244a-4cb2-a840-67181a8466a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "cinder-quobyte-87921e0b-244a-4cb2-a840-67181a8466a2" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-quobyte-87921e0b-244a-4cb2-a840-67181a8466a2" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93dd75-a34e-45f2-b1a7-23c30a72b97f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:57 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 1073741824" returned: 0 in 0.621s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:57 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2 Sep 02 00:03:57 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:57 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 Sep 02 00:03:57 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:58 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8" returned: 0 in 0.258s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de3d80a-bdf4-4b9f-93d5-6522c07a841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1eba93-8c32-4a40-96ab-68f28a068845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Volume volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 (53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8): created successfully Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1eba93-8c32-4a40-96ab-68f28a068845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:58 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Flow 'volume_create_manager' (1c284ff1-303d-40be-a6d6-4b6325105792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2" returned: 0 in 0.444s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-98e67859-af05-4365-93ce-20925e43bde2 tempest-AbsoluteLimitsTests-1528246479 None] Created volume successfully. Sep 02 00:03:58 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2 Sep 02 00:03:58 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:58 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-87921e0b-244a-4cb2-a840-67181a8466a2" returned: 0 in 0.253s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-quobyte-87921e0b-244a-4cb2-a840-67181a8466a2" released by "delete_volume" :: held 0.749s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Created reservations ['5c260b55-5114-4f63-a8cc-d2f0701c4d7a', '5b644ac9-565f-4986-a564-ce81ffa53744', 'e6eddfd3-bf9b-4f94-9180-f6dc37b04394', 'c1b4eecf-18b3-4f7e-b05f-f7254b24b46f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:58 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:03:58 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:58 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:03:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Deleted volume successfully. Sep 02 00:03:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b40bc67e-4e48-4d53-a0ca-74e8312f45c1 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-87921e0b-244a-4cb2-a840-67181a8466a2-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:03:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-89d8e2e5-09c7-4704-9260-a027937f7d0c req-09a9fa0d-7478-43f8-a236-6c3d636e689f tempest-TestInstancesWithCinderVolumes-2010248593 None] Terminate volume connection completed successfully. Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-89d8e2e5-09c7-4704-9260-a027937f7d0c req-09a9fa0d-7478-43f8-a236-6c3d636e689f tempest-TestInstancesWithCinderVolumes-2010248593 None] Deleting attachment 81c6483d-7656-409b-b7fa-834f09b64130. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Acquiring lock "cinder-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Lock "cinder-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Flow 'volume_create_manager' (f513a01e-d5ed-4c48-a806-4b94b64b43b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71a904c-7679-40ae-9ff6-a91df5939416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71a904c-7679-40ae-9ff6-a91df5939416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719625682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef507bd-9ba4-4319-83f5-c9e44688e28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f780df9986564f6680b177bf0a7b81a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:59Z,use_quota=True,user_id='e1f3643522f94273957dced8a2014c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ad2b25-242d-4e0b-9ea9-2cbeea424e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ad2b25-242d-4e0b-9ea9-2cbeea424e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad790d42-5381-4d26-9af0-84929951fe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad790d42-5381-4d26-9af0-84929951fe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef507bd-9ba4-4319-83f5-c9e44688e28d', 'volume_name': 'volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb17633-090e-4578-b740-78b7becda8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb17633-090e-4578-b740-78b7becda8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275af9bd-406f-45d7-aa46-5b727f28e535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:03:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Volume 8ef507bd-9ba4-4319-83f5-c9e44688e28d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d', 'volume_size': 1} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719625682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef507bd-9ba4-4319-83f5-c9e44688e28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f780df9986564f6680b177bf0a7b81a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:03:59Z,use_quota=True,user_id='e1f3643522f94273957dced8a2014c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Creating volume 8ef507bd-9ba4-4319-83f5-c9e44688e28d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:03:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Acquiring lock "cinder-quobyte-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:03:59 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d 1073741824 Sep 02 00:03:59 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Lock "cinder-quobyte-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[109b53c6-2f00-45c9-a47a-60f196070ade]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:59 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 Sep 02 00:03:59 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:59 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d 1073741824" returned: 0 in 0.456s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:59 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:59 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8 Sep 02 00:03:59 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:03:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:03:59 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d Sep 02 00:03:59 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "cinder-e9d1994a-9143-44f0-b6a0-3e1d56b484be-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-e9d1994a-9143-44f0-b6a0-3e1d56b484be-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "cinder-quobyte-e9d1994a-9143-44f0-b6a0-3e1d56b484be" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-quobyte-e9d1994a-9143-44f0-b6a0-3e1d56b484be" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c576afe3-9a0b-4d40-9f22-dbeb53a0aec7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:00 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Lock "cinder-quobyte-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8" released by "delete_volume" :: held 0.790s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:00 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275af9bd-406f-45d7-aa46-5b727f28e535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca82ea6-bf47-406a-b85f-10b19e6c0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:00 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be Sep 02 00:04:00 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Volume volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d (8ef507bd-9ba4-4319-83f5-c9e44688e28d): created successfully Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca82ea6-bf47-406a-b85f-10b19e6c0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Flow 'volume_create_manager' (f513a01e-d5ed-4c48-a806-4b94b64b43b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-62c8b03a-11a1-4172-b8ce-832c85fd8ad5 tempest-ProjectReaderTests-1683439344 None] Created volume successfully. Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Created reservations ['1571dda4-5952-4084-b586-3cebf9eb10cb', '63898112-4584-450e-b5dd-68c3f1095a83', '96770930-2092-4e5d-a1e2-925b88ac3bee', '156a6c1b-8d92-4707-9bec-ecfa2cfee181'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:00 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:00 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:00 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:00 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be Sep 02 00:04:00 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:00 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.289s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Deleted volume successfully. Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9098fecb-0029-4cfa-bccf-5dae74d682d0 tempest-AbsoluteLimitsTests-1528246479 None] Lock "cinder-53cb86e0-c65e-409a-ad28-bc8b9eb2b9a8-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:00 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e9d1994a-9143-44f0-b6a0-3e1d56b484be" returned: 0 in 0.298s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-quobyte-e9d1994a-9143-44f0-b6a0-3e1d56b484be" released by "delete_volume" :: held 0.808s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:00 devstack cinder-volume[86591]: WARNING cinder.quota [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1545731460-651167061 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1545731460-651167061, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:04:00 devstack cinder-volume[86591]: WARNING cinder.quota [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1545731460-651167061 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1545731460-651167061, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:04:00 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Created reservations ['19b7128d-7e5c-4424-9115-79e531f3a1ff', '6005a018-496c-4d08-b116-dd5bf08fded4', '161f1cec-5401-494e-a636-eb97f9a7ecf9', '924df28b-4cc3-4d4e-9b16-ed0ff399b791'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:01 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:01 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:01 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Deleted volume successfully. Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ea332d29-cc27-4022-b33a-364cfd05b3fe tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-e9d1994a-9143-44f0-b6a0-3e1d56b484be-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "cinder-8ef507bd-9ba4-4319-83f5-c9e44688e28d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-8ef507bd-9ba4-4319-83f5-c9e44688e28d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "cinder-quobyte-8ef507bd-9ba4-4319-83f5-c9e44688e28d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-quobyte-8ef507bd-9ba4-4319-83f5-c9e44688e28d" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f3cc9b-f247-4a99-91f5-69a2d297c5b2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:01 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d Sep 02 00:04:01 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:02 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:02 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d Sep 02 00:04:02 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:02 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8ef507bd-9ba4-4319-83f5-c9e44688e28d" returned: 0 in 0.283s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-quobyte-8ef507bd-9ba4-4319-83f5-c9e44688e28d" released by "delete_volume" :: held 0.739s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Created reservations ['6f5f2bd9-43ca-438a-a4f8-8fd2808f4386', '1668758b-6d63-42a3-87a9-846c3c7649d8', '30babe2e-4114-4458-8b87-a558b082928d', '976c81fb-ce7d-4240-a7c5-cb782cf18d2a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:02 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:02 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:02 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Deleted volume successfully. Sep 02 00:04:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5a721f01-3902-4173-8eaf-62b20390c622 tempest-ProjectReaderTests-1683439344 None] Lock "cinder-8ef507bd-9ba4-4319-83f5-c9e44688e28d-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Flow 'volume_create_manager' (23ebd874-9a98-4641-a8d4-aad45bda7ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340a2a87-8a76-49d3-be9a-81998d28a593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340a2a87-8a76-49d3-be9a-81998d28a593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1588055180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb97942c-f2f4-47b0-8f85-775873215de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f780df9986564f6680b177bf0a7b81a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:03Z,use_quota=True,user_id='e1f3643522f94273957dced8a2014c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac24acf-79bd-4590-a463-a98955c8c74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac24acf-79bd-4590-a463-a98955c8c74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5105be-c115-4f95-94ea-7182516ce888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5105be-c115-4f95-94ea-7182516ce888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb97942c-f2f4-47b0-8f85-775873215de5', 'volume_name': 'volume-bb97942c-f2f4-47b0-8f85-775873215de5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430e36d2-8752-4251-bce4-3c6340bbcafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430e36d2-8752-4251-bce4-3c6340bbcafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915abccc-b5e4-47e3-a8d1-17aee587e0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Volume bb97942c-f2f4-47b0-8f85-775873215de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb97942c-f2f4-47b0-8f85-775873215de5', 'volume_size': 1} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1588055180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb97942c-f2f4-47b0-8f85-775873215de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f780df9986564f6680b177bf0a7b81a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:03Z,use_quota=True,user_id='e1f3643522f94273957dced8a2014c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Creating volume bb97942c-f2f4-47b0-8f85-775873215de5 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:04:03 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:03 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5 1073741824 Sep 02 00:04:03 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-d208a3ea-8d53-41a5-acfa-a337b267734a req-1ee22d07-9e69-444f-96e2-abbef110476b tempest-TestInstancesWithCinderVolumes-2010248593 None] Terminate volume connection completed successfully. Sep 02 00:04:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-d208a3ea-8d53-41a5-acfa-a337b267734a req-1ee22d07-9e69-444f-96e2-abbef110476b tempest-TestInstancesWithCinderVolumes-2010248593 None] Deleting attachment 6f60e37c-faed-4e0a-9474-946e8ca93c54. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:04:04 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5 1073741824" returned: 0 in 0.713s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:04 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5 Sep 02 00:04:04 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:04 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5" returned: 0 in 0.397s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915abccc-b5e4-47e3-a8d1-17aee587e0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb97942c-f2f4-47b0-8f85-775873215de5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b29358-9f8d-4d14-9e7b-596e96a4a141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "cinder-23af3b84-d51c-48bb-8321-f904c73540ca-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Volume volume-bb97942c-f2f4-47b0-8f85-775873215de5 (bb97942c-f2f4-47b0-8f85-775873215de5): created successfully Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b29358-9f8d-4d14-9e7b-596e96a4a141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Flow 'volume_create_manager' (23ebd874-9a98-4641-a8d4-aad45bda7ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-23af3b84-d51c-48bb-8321-f904c73540ca-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5afaeec5-8ef3-4536-b47a-3b183b365474 tempest-ProjectReaderTests-1683439344 None] Created volume successfully. Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "cinder-quobyte-23af3b84-d51c-48bb-8321-f904c73540ca" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-quobyte-23af3b84-d51c-48bb-8321-f904c73540ca" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d80051a-ae82-464a-b394-8369216fc405]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:04 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca Sep 02 00:04:04 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:05 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca" returned: 0 in 0.418s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:05 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca Sep 02 00:04:05 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Acquiring lock "cinder-bb97942c-f2f4-47b0-8f85-775873215de5-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Lock "cinder-bb97942c-f2f4-47b0-8f85-775873215de5-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:05 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23af3b84-d51c-48bb-8321-f904c73540ca" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-quobyte-23af3b84-d51c-48bb-8321-f904c73540ca" released by "delete_volume" :: held 0.870s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Acquiring lock "cinder-quobyte-bb97942c-f2f4-47b0-8f85-775873215de5" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:05 devstack cinder-volume[86591]: WARNING cinder.quota [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1721096348-1160294202 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1721096348-1160294202, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:04:05 devstack cinder-volume[86591]: WARNING cinder.quota [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1721096348-1160294202 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1721096348-1160294202, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Lock "cinder-quobyte-bb97942c-f2f4-47b0-8f85-775873215de5" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb8bbb-74b1-4672-a2af-935b673d5e8a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Created reservations ['e5cbf803-45c2-416e-8051-9b597aa0ff6b', '644a63ec-7e4b-4465-bb49-259c609bdd4c', '48b0261e-78c9-439a-9914-d9270ebc27b3', '7cb94c83-e478-4c84-97f1-6c6557f5ed1d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:05 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5 Sep 02 00:04:05 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:06 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:06 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:06 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Deleted volume successfully. Sep 02 00:04:06 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5" returned: 0 in 0.492s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f3fec872-3729-4b78-91f8-03f976bb7521 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-23af3b84-d51c-48bb-8321-f904c73540ca-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:06 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5 Sep 02 00:04:06 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:06 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:06 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:06 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bb97942c-f2f4-47b0-8f85-775873215de5" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Lock "cinder-quobyte-bb97942c-f2f4-47b0-8f85-775873215de5" released by "delete_volume" :: held 0.905s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Created reservations ['011eef2f-0859-45e5-ab1e-281477e06b4e', '161d1c2d-a495-4308-940b-cc8e42733150', 'a5d71ba9-a2c6-4980-8b10-52aa6bbdced6', '0c08460f-39eb-4520-96f9-8b9d2e6159c5'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:06 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:06 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:06 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.485s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:04:07 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Deleted volume successfully. Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-320261b7-968f-48d2-a799-7ccbc9d2b3ba tempest-ProjectReaderTests-1683439344 None] Lock "cinder-bb97942c-f2f4-47b0-8f85-775873215de5-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Flow 'volume_create_manager' (283a4f19-76da-499b-a78d-ec7573553598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3db8db3-9786-46f4-8b64-8729c2dc0d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3db8db3-9786-46f4-8b64-8729c2dc0d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-756263155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a531ac3f-7afa-4203-abf2-363f5717119d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b9b246b242d4f07960a520ed19c3f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:07Z,use_quota=True,user_id='5baa382561a34ffca8407386d035f1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db22cd76-c3a5-4c3e-81fa-e2e24feee857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db22cd76-c3a5-4c3e-81fa-e2e24feee857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c58d511-61ac-4dc5-91b0-dd62fca0518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c58d511-61ac-4dc5-91b0-dd62fca0518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a531ac3f-7afa-4203-abf2-363f5717119d', 'volume_name': 'volume-a531ac3f-7afa-4203-abf2-363f5717119d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9c7eb8-17a0-4408-bfcb-7650c02dadbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9c7eb8-17a0-4408-bfcb-7650c02dadbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1611499-4142-4bd1-8df1-9ac2ea8ca69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Volume a531ac3f-7afa-4203-abf2-363f5717119d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a531ac3f-7afa-4203-abf2-363f5717119d', 'volume_size': 1} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-756263155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a531ac3f-7afa-4203-abf2-363f5717119d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b9b246b242d4f07960a520ed19c3f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:07Z,use_quota=True,user_id='5baa382561a34ffca8407386d035f1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Creating volume a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:04:07 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:04:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:07 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d 1073741824 Sep 02 00:04:07 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:04:08 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Flow 'volume_create_manager' (756a442f-4b8f-483b-a79e-453f4914fef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232dc58e-b2d1-441a-9e6d-a1af5d68cd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d 1073741824" returned: 0 in 0.705s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232dc58e-b2d1-441a-9e6d-a1af5d68cd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-202916156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebf8314-57be-49c4-9706-0c0274753a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf1af1ef8774407bbd17d9341499e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:08Z,use_quota=True,user_id='162912728b4e499b81b5bfe82d5dfa79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550b3fba-8edd-4765-9585-7374ad8feb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550b3fba-8edd-4765-9585-7374ad8feb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8691025c-316f-4c87-820c-a6494917c705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8691025c-316f-4c87-820c-a6494917c705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebf8314-57be-49c4-9706-0c0274753a89', 'volume_name': 'volume-eebf8314-57be-49c4-9706-0c0274753a89', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7c435d-3b34-4bc2-a353-208207011889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7c435d-3b34-4bc2-a353-208207011889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6483bb-8d75-4dc4-8dda-b5ab3fc1ee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Volume eebf8314-57be-49c4-9706-0c0274753a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebf8314-57be-49c4-9706-0c0274753a89', 'volume_size': 1} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:08 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d Sep 02 00:04:08 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:08 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d" returned: 0 in 0.415s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-202916156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebf8314-57be-49c4-9706-0c0274753a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf1af1ef8774407bbd17d9341499e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:08Z,use_quota=True,user_id='162912728b4e499b81b5bfe82d5dfa79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Creating volume eebf8314-57be-49c4-9706-0c0274753a89 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:04:08 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:08 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89 1073741824 Sep 02 00:04:08 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1611499-4142-4bd1-8df1-9ac2ea8ca69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a531ac3f-7afa-4203-abf2-363f5717119d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dd10f7-d5f6-4751-82d0-74a8b6d075a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Volume volume-a531ac3f-7afa-4203-abf2-363f5717119d (a531ac3f-7afa-4203-abf2-363f5717119d): created successfully Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dd10f7-d5f6-4751-82d0-74a8b6d075a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Flow 'volume_create_manager' (283a4f19-76da-499b-a78d-ec7573553598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-10823940-4038-4630-a33d-61a0c9d7dbc3 tempest-VolumesDeleteCascade-1057835110 None] Created volume successfully. Sep 02 00:04:09 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89 1073741824" returned: 0 in 0.786s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:09 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89 Sep 02 00:04:09 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:09 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89" returned: 0 in 0.362s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.158s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6483bb-8d75-4dc4-8dda-b5ab3fc1ee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebf8314-57be-49c4-9706-0c0274753a89', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504fd863-32f8-4142-b725-cbcadb4595bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Creating offline snapshot f9b377a8-269c-4727-8d5c-f9bc939ca9a0 of volume a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:04:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Volume volume-eebf8314-57be-49c4-9706-0c0274753a89 (eebf8314-57be-49c4-9706-0c0274753a89): created successfully Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504fd863-32f8-4142-b725-cbcadb4595bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Flow 'volume_create_manager' (756a442f-4b8f-483b-a79e-453f4914fef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe0835-38f8-414b-bda8-2a4b6474c1c4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-de23f8b8-5695-47a7-8574-5bbe7b47534a tempest-AttachVolumeNegativeTest-328114835 None] Created volume successfully. Sep 02 00:04:10 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d Sep 02 00:04:10 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:10 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d" returned: 0 in 0.744s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:10 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 1G Sep 02 00:04:10 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-514624e7-9190-4e46-b53f-5d3952d2c8d9 req-b44950dc-f7f9-4dab-9f3c-0490f41c98e0 tempest-TestInstancesWithCinderVolumes-2010248593 None] Terminate volume connection completed successfully. Sep 02 00:04:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-514624e7-9190-4e46-b53f-5d3952d2c8d9 req-b44950dc-f7f9-4dab-9f3c-0490f41c98e0 tempest-TestInstancesWithCinderVolumes-2010248593 None] Deleting attachment a80fcb6d-22eb-4b39-a61d-1624aa1a35d5. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:04:11 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 1G" returned: 0 in 0.488s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531ac3f-7afa-4203-abf2-363f5717119d -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-0f758764-dd1f-4a75-ad0f-bba2e2403ba0 req-e97f281f-f0f2-4d69-b223-b4389c9ee5dc tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:11 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531ac3f-7afa-4203-abf2-363f5717119d -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 Sep 02 00:04:11 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:11 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531ac3f-7afa-4203-abf2-363f5717119d -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:11 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 is being set with open permissions: ugo+rw Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:11 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 Sep 02 00:04:11 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:11 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0" returned: 0 in 0.238s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "cinder-872cae90-3e88-414e-9b20-c8f572e21e92-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-872cae90-3e88-414e-9b20-c8f572e21e92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:11 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.info Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "cinder-quobyte-872cae90-3e88-414e-9b20-c8f572e21e92" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:11 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-quobyte-872cae90-3e88-414e-9b20-c8f572e21e92" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f679bd-9856-4f94-9c0b-a2cf14474254]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:12 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 Sep 02 00:04:12 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:12 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.info" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:12 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.info is being set with open permissions: ugo+rw Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:12 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.info Sep 02 00:04:12 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:12 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92" returned: 0 in 0.357s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:12 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92 Sep 02 00:04:12 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:12 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.info" returned: 0 in 0.252s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-0f758764-dd1f-4a75-ad0f-bba2e2403ba0 req-e97f281f-f0f2-4d69-b223-b4389c9ee5dc tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.137s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-0f758764-dd1f-4a75-ad0f-bba2e2403ba0 req-e97f281f-f0f2-4d69-b223-b4389c9ee5dc tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5f6b5649-24e1-4d96-b44e-2b628235aceb tempest-VolumesDeleteCascade-1057835110 None] Create snapshot completed successfully Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-0f758764-dd1f-4a75-ad0f-bba2e2403ba0 req-e97f281f-f0f2-4d69-b223-b4389c9ee5dc tempest-AttachVolumeNegativeTest-328114835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-eebf8314-57be-49c4-9706-0c0274753a89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '019d4db7-cb20-4778-a998-cd9a00690b31', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:04:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-0f758764-dd1f-4a75-ad0f-bba2e2403ba0 req-e97f281f-f0f2-4d69-b223-b4389c9ee5dc tempest-AttachVolumeNegativeTest-328114835 None] attachment_update completed successfully. Sep 02 00:04:12 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-872cae90-3e88-414e-9b20-c8f572e21e92" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-quobyte-872cae90-3e88-414e-9b20-c8f572e21e92" released by "delete_volume" :: held 0.658s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:12 devstack cinder-volume[86591]: WARNING cinder.quota [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2141488078-861502361 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2141488078-861502361, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:04:12 devstack cinder-volume[86591]: WARNING cinder.quota [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2141488078-861502361 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2141488078-861502361, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Created reservations ['b8c276f1-8efc-4d3b-b850-6508c2908d45', '81a83029-d44d-4312-a203-a7390011448a', '3bde9bec-abe3-4e61-bb89-62f4fea936e4', '53ffaaed-5636-40d1-a528-72b246108426'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:12 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:12 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:12 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.266s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Deleted volume successfully. Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ed694a9-ded9-4f29-b8ad-60c944adc854 tempest-TestInstancesWithCinderVolumes-2010248593 None] Lock "cinder-872cae90-3e88-414e-9b20-c8f572e21e92-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Creating offline snapshot 728194a0-746d-4f68-87f4-390d35679a1f of volume a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2784c64f-8a08-47b3-b5a3-6b0eb8af106d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:13 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 Sep 02 00:04:13 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:13 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0" returned: 0 in 0.426s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531ac3f-7afa-4203-abf2-363f5717119d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:04:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:13 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f 1G Sep 02 00:04:13 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:14 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f 1G" returned: 0 in 0.419s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:14 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f Sep 02 00:04:14 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:14 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:14 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f is being set with open permissions: ugo+rw Sep 02 00:04:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:14 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f Sep 02 00:04:14 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:14 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f" returned: 0 in 0.344s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.662s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d83c5be1-593e-4193-88c6-e6bbf8bffb4a tempest-VolumesDeleteCascade-1057835110 None] Create snapshot completed successfully Sep 02 00:04:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-ff5705e7-c447-434f-a93d-ed7aec6cbdf8 req-2df8c28d-3501-4c99-b92f-65018336a892 tempest-AttachVolumeNegativeTest-328114835 None] Terminate volume connection completed successfully. Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-ff5705e7-c447-434f-a93d-ed7aec6cbdf8 req-2df8c28d-3501-4c99-b92f-65018336a892 tempest-AttachVolumeNegativeTest-328114835 None] Deleting attachment 019d4db7-cb20-4778-a998-cd9a00690b31. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-a531ac3f-7afa-4203-abf2-363f5717119d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-a531ac3f-7afa-4203-abf2-363f5717119d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Performing cascade delete. {{(pid=86591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-728194a0-746d-4f68-87f4-390d35679a1f-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-728194a0-746d-4f68-87f4-390d35679a1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-a531ac3f-7afa-4203-abf2-363f5717119d" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-a531ac3f-7afa-4203-abf2-363f5717119d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-728194a0-746d-4f68-87f4-390d35679a1f" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-728194a0-746d-4f68-87f4-390d35679a1f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Deleting offline snapshot 728194a0-746d-4f68-87f4-390d35679a1f of volume a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] snapshot_file for this snap is: volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff82b1ab-77be-448e-8cf0-241483f8a8ca]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:15 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f Sep 02 00:04:15 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:16 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f" returned: 0 in 0.394s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531ac3f-7afa-4203-abf2-363f5717119d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:04:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d12d29c-124c-43fc-92b2-b20a696f0e7e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:16 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 Sep 02 00:04:16 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:16 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0" returned: 0 in 0.475s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531ac3f-7afa-4203-abf2-363f5717119d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:04:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:16 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f Sep 02 00:04:16 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:17 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f" returned: 0 in 0.566s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:17 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f Sep 02 00:04:17 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:17 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.728194a0-746d-4f68-87f4-390d35679a1f" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-728194a0-746d-4f68-87f4-390d35679a1f" released by "_delete_snapshot" :: held 1.815s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-a531ac3f-7afa-4203-abf2-363f5717119d" released by "delete_snapshot" :: held 1.846s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Created reservations ['aad7f60c-3d8b-4fec-bea5-99c9f7883086', 'df333c79-64f9-403f-9e88-ffd75c26177c', '330b317d-e1de-4f64-9be3-c627cf70f203', '99101d11-05f9-40d6-a714-7e6cdab6c250'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Delete snapshot completed successfully. Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-728194a0-746d-4f68-87f4-390d35679a1f-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-f9b377a8-269c-4727-8d5c-f9bc939ca9a0-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-f9b377a8-269c-4727-8d5c-f9bc939ca9a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-a531ac3f-7afa-4203-abf2-363f5717119d" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-a531ac3f-7afa-4203-abf2-363f5717119d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-f9b377a8-269c-4727-8d5c-f9bc939ca9a0" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-f9b377a8-269c-4727-8d5c-f9bc939ca9a0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Deleting offline snapshot f9b377a8-269c-4727-8d5c-f9bc939ca9a0 of volume a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] snapshot_file for this snap is: volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e558b35-4024-4a56-a5e3-ea2842d19aff]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:17 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 Sep 02 00:04:17 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:18 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0" returned: 0 in 0.499s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531ac3f-7afa-4203-abf2-363f5717119d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:04:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab5a2c2-56fb-4223-a037-11ed11a48545]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:18 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d Sep 02 00:04:18 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:18 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:18 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 Sep 02 00:04:18 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:19 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:19 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0 Sep 02 00:04:19 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:19 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d.f9b377a8-269c-4727-8d5c-f9bc939ca9a0" returned: 0 in 0.244s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-f9b377a8-269c-4727-8d5c-f9bc939ca9a0" released by "_delete_snapshot" :: held 1.824s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-a531ac3f-7afa-4203-abf2-363f5717119d" released by "delete_snapshot" :: held 1.851s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Created reservations ['9ce338e4-030c-452a-ae43-a588c4dd5539', 'd15c154c-442a-4a94-be17-953060a59f30', '64b626db-0cf1-4100-936a-40f7719b3968', '48e4ea17-1257-496b-8e10-68639b07e6c6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Delete snapshot completed successfully. Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-f9b377a8-269c-4727-8d5c-f9bc939ca9a0-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Snapshots deleted, issuing volume delete {{(pid=86591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-a531ac3f-7afa-4203-abf2-363f5717119d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-a531ac3f-7afa-4203-abf2-363f5717119d" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[42427302-a65d-4e09-8efe-0a101130deb5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:19 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d Sep 02 00:04:19 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:20 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d" returned: 0 in 0.416s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:20 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d Sep 02 00:04:20 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:20 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a531ac3f-7afa-4203-abf2-363f5717119d" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-a531ac3f-7afa-4203-abf2-363f5717119d" released by "delete_volume" :: held 0.828s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "cinder-eebf8314-57be-49c4-9706-0c0274753a89-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-eebf8314-57be-49c4-9706-0c0274753a89-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "cinder-quobyte-eebf8314-57be-49c4-9706-0c0274753a89" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-quobyte-eebf8314-57be-49c4-9706-0c0274753a89" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Created reservations ['02f0de3c-ceb0-4f28-abd4-1df10323e6f6', '739e7330-870e-4289-8139-b383dbc75842', '8968a950-2302-4495-b312-f3b62f74cdfe', '7b35ecb9-61eb-4954-acd5-da8673bc5b7b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a02805a-f131-4679-a81d-eea2300734ea]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:20 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89 Sep 02 00:04:20 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:20 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:20 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:21 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.302s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Deleted volume successfully. Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8d6e054e-bb3a-4c5b-9595-b1ef7f6a40f4 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-a531ac3f-7afa-4203-abf2-363f5717119d-delete_volume" released by "delete_volume" :: held 5.649s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:21 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89" returned: 0 in 0.490s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:21 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89 Sep 02 00:04:21 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:21 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-eebf8314-57be-49c4-9706-0c0274753a89" returned: 0 in 0.257s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-quobyte-eebf8314-57be-49c4-9706-0c0274753a89" released by "delete_volume" :: held 0.800s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Created reservations ['4dcc043b-7977-40e1-b4bf-7b46bef057e9', 'b4f847a4-fe99-4140-925f-c6e04e668ac0', 'e2844f20-fec9-4ed3-8ea2-bfd217c97747', 'bfe7f58f-544a-4310-94cd-e4079ab8693b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:21 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:21 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Flow 'volume_create_manager' (743b3bfb-0763-4464-960e-8f045c2fddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e2f7ca-7d9b-41c0-a0a9-1138be1a067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e2f7ca-7d9b-41c0-a0a9-1138be1a067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2067856819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff18594-28cb-4726-b7c1-ac042b670d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b9b246b242d4f07960a520ed19c3f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:22Z,use_quota=True,user_id='5baa382561a34ffca8407386d035f1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ab4cea-8bc8-44aa-94cc-5f6d6d4134d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ab4cea-8bc8-44aa-94cc-5f6d6d4134d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4a9923-b216-4a01-9160-a8097cae326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4a9923-b216-4a01-9160-a8097cae326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff18594-28cb-4726-b7c1-ac042b670d85', 'volume_name': 'volume-4ff18594-28cb-4726-b7c1-ac042b670d85', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36d451f-a38c-4d04-97c9-ab7f790e469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36d451f-a38c-4d04-97c9-ab7f790e469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8537c216-ccba-4409-8b59-f3c722e5c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Volume 4ff18594-28cb-4726-b7c1-ac042b670d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff18594-28cb-4726-b7c1-ac042b670d85', 'volume_size': 1} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2067856819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff18594-28cb-4726-b7c1-ac042b670d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b9b246b242d4f07960a520ed19c3f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:22Z,use_quota=True,user_id='5baa382561a34ffca8407386d035f1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Creating volume 4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:04:21 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:04:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "cinder-a32d279a-bada-4267-90f0-7c8f24751180-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:22 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 1073741824 Sep 02 00:04:22 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-a32d279a-bada-4267-90f0-7c8f24751180-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "cinder-quobyte-a32d279a-bada-4267-90f0-7c8f24751180" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:22 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-quobyte-a32d279a-bada-4267-90f0-7c8f24751180" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.440s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Deleted volume successfully. Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d2ab1a-b4ea-4744-b289-c758897fbed8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3533d8ab-2ceb-4355-b2e3-cf018f89e15e tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-eebf8314-57be-49c4-9706-0c0274753a89-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:22 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180 Sep 02 00:04:22 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:22 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 1073741824" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:22 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 Sep 02 00:04:22 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:22 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180" returned: 0 in 0.392s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:22 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180 Sep 02 00:04:22 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:22 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85" returned: 0 in 0.271s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8537c216-ccba-4409-8b59-f3c722e5c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff18594-28cb-4726-b7c1-ac042b670d85', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0a753a-c235-4cfa-a84d-2c7e314051aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:22 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Volume volume-4ff18594-28cb-4726-b7c1-ac042b670d85 (4ff18594-28cb-4726-b7c1-ac042b670d85): created successfully Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0a753a-c235-4cfa-a84d-2c7e314051aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Flow 'volume_create_manager' (743b3bfb-0763-4464-960e-8f045c2fddf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:22 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a32d279a-bada-4267-90f0-7c8f24751180" returned: 0 in 0.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7914e41f-6cda-47a7-bcf9-51040726156a tempest-VolumesDeleteCascade-1057835110 None] Created volume successfully. Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-quobyte-a32d279a-bada-4267-90f0-7c8f24751180" released by "delete_volume" :: held 0.717s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Created reservations ['d6e748e9-12e4-463a-90fe-7f8dcb2123c8', '9d3d119f-7803-45a0-9514-ad71786e0f5b', '78384a6e-2ad7-416d-a0b9-2edfe79ef7fa', '4bdf9a4a-7a59-4081-8f91-f871f790423c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:23 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:23 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:23 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:23 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Deleted volume successfully. Sep 02 00:04:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8b27b923-5375-4360-a023-bb276eaf8de2 tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-a32d279a-bada-4267-90f0-7c8f24751180-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "cinder-e12acd65-b288-4080-879e-20fe81329389-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-e12acd65-b288-4080-879e-20fe81329389-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "cinder-quobyte-e12acd65-b288-4080-879e-20fe81329389" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-quobyte-e12acd65-b288-4080-879e-20fe81329389" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[06020260-4264-4931-a998-ba0564a21ee7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:23 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389 Sep 02 00:04:23 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:24 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:24 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389 Sep 02 00:04:24 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Creating offline snapshot cd6572ce-beb5-4cf3-b618-90540e2396bf of volume 4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e334b436-6a55-47a5-872f-265e4b106dce]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:24 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 Sep 02 00:04:24 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:24 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e12acd65-b288-4080-879e-20fe81329389" returned: 0 in 0.293s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-quobyte-e12acd65-b288-4080-879e-20fe81329389" released by "delete_volume" :: held 0.781s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Created reservations ['13f2ee86-85d1-443b-8060-0599248b079b', 'ed00ac97-80b4-40c1-b7b3-e9a24f8b52de', 'add9f23c-ad4d-4c62-966d-4cc9e5ce17e0', 'ac5c0c2c-0a44-462b-b462-5498ea59255b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:24 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:24 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:24 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85" returned: 0 in 0.455s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:24 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf 1G Sep 02 00:04:24 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:24 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.299s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Deleted volume successfully. Sep 02 00:04:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bab730bc-6447-499e-a858-d499c60fd921 tempest-AttachVolumeNegativeTest-328114835 None] Lock "cinder-e12acd65-b288-4080-879e-20fe81329389-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:25 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf 1G" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff18594-28cb-4726-b7c1-ac042b670d85 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:25 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff18594-28cb-4726-b7c1-ac042b670d85 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf Sep 02 00:04:25 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:25 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff18594-28cb-4726-b7c1-ac042b670d85 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:25 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf is being set with open permissions: ugo+rw Sep 02 00:04:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:25 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf Sep 02 00:04:25 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:25 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf" returned: 0 in 0.353s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:25 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.info Sep 02 00:04:25 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:26 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.info" returned: 0 in 0.304s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:26 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.info is being set with open permissions: ugo+rw Sep 02 00:04:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:26 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.info Sep 02 00:04:26 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:26 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.info" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fe88d534-8de3-4cb7-86b9-da5d46f4cb32 tempest-VolumesDeleteCascade-1057835110 None] Create snapshot completed successfully Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Flow 'volume_create_manager' (ee5dc055-f5a9-455a-bc0c-aa56f2bb6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6dd6af-0c9f-4a51-b575-66d7aafce7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6dd6af-0c9f-4a51-b575-66d7aafce7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1183942277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4eebd2-6bfc-4809-9749-672ddc65af43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b9b246b242d4f07960a520ed19c3f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd6572ce-beb5-4cf3-b618-90540e2396bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:28Z,use_quota=True,user_id='5baa382561a34ffca8407386d035f1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a759db9-9bd9-4f65-bf20-9b276bb967e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a759db9-9bd9-4f65-bf20-9b276bb967e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28b45b9-5730-4d10-9317-a647c23e6db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28b45b9-5730-4d10-9317-a647c23e6db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d4eebd2-6bfc-4809-9749-672ddc65af43', 'volume_name': 'volume-2d4eebd2-6bfc-4809-9749-672ddc65af43', 'volume_size': 1, 'snapshot_id': 'cd6572ce-beb5-4cf3-b618-90540e2396bf'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6fa8b3-479c-426b-9ea7-383fbdf00ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6fa8b3-479c-426b-9ea7-383fbdf00ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff2509c-1aeb-447c-a0e8-383cd951b09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:27 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Volume 2d4eebd2-6bfc-4809-9749-672ddc65af43: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d4eebd2-6bfc-4809-9749-672ddc65af43', 'volume_size': 1, 'snapshot_id': 'cd6572ce-beb5-4cf3-b618-90540e2396bf'} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-cd6572ce-beb5-4cf3-b618-90540e2396bf-2d4eebd2-6bfc-4809-9749-672ddc65af43" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-cd6572ce-beb5-4cf3-b618-90540e2396bf-2d4eebd2-6bfc-4809-9749-672ddc65af43" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Creating volume 2d4eebd2-6bfc-4809-9749-672ddc65af43 from snapshot cd6572ce-beb5-4cf3-b618-90540e2396bf {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-2d4eebd2-6bfc-4809-9749-672ddc65af43" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-2d4eebd2-6bfc-4809-9749-672ddc65af43" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] snapshot: cd6572ce-beb5-4cf3-b618-90540e2396bf, volume: 2d4eebd2-6bfc-4809-9749-672ddc65af43, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e7d001-d9b4-48da-a5d7-177cc04ca09c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:28 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf Sep 02 00:04:28 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:28 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf" returned: 0 in 0.398s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ff18594-28cb-4726-b7c1-ac042b670d85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a757ebb8-c381-4c1f-ace3-208f4884fea2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:28 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 Sep 02 00:04:28 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:29 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85" returned: 0 in 0.552s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:04:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:04:29 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:04:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:29 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 Sep 02 00:04:29 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:34 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43" returned: 0 in 5.634s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:34 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:04:34 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Converted 1024.00 MB image at 181.71 MB/s Sep 02 00:04:34 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 is being set with open permissions: ugo+rw Sep 02 00:04:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:34 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 Sep 02 00:04:34 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:34 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-2d4eebd2-6bfc-4809-9749-672ddc65af43" released by "_copy_volume_from_snapshot" :: held 6.962s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-cd6572ce-beb5-4cf3-b618-90540e2396bf-2d4eebd2-6bfc-4809-9749-672ddc65af43" released by "_create_volume_from_snapshot" :: held 7.038s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.055s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff2509c-1aeb-447c-a0e8-383cd951b09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d4eebd2-6bfc-4809-9749-672ddc65af43', 'volume_size': 1, 'snapshot_id': 'cd6572ce-beb5-4cf3-b618-90540e2396bf'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9077a4-484f-4da3-a552-501a4aeea333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Volume volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 (2d4eebd2-6bfc-4809-9749-672ddc65af43): created successfully Sep 02 00:04:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9077a4-484f-4da3-a552-501a4aeea333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Flow 'volume_create_manager' (ee5dc055-f5a9-455a-bc0c-aa56f2bb6c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-eca07a57-a57c-4f80-bb4e-0f0149035e77 tempest-VolumesDeleteCascade-1057835110 None] Created volume successfully. Sep 02 00:04:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-4ff18594-28cb-4726-b7c1-ac042b670d85-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-4ff18594-28cb-4726-b7c1-ac042b670d85-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Performing cascade delete. {{(pid=86591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-cd6572ce-beb5-4cf3-b618-90540e2396bf-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-cd6572ce-beb5-4cf3-b618-90540e2396bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-4ff18594-28cb-4726-b7c1-ac042b670d85" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-4ff18594-28cb-4726-b7c1-ac042b670d85" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-cd6572ce-beb5-4cf3-b618-90540e2396bf" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-cd6572ce-beb5-4cf3-b618-90540e2396bf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Deleting offline snapshot cd6572ce-beb5-4cf3-b618-90540e2396bf of volume 4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] snapshot_file for this snap is: volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c527ad2-b202-4ea4-9b8e-ec42781086f1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:36 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf Sep 02 00:04:36 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Flow 'volume_create_manager' (1472ccc8-1062-47c6-a36c-cd701c08ae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a136e27-2fce-4020-aef6-36ddbc97f163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a136e27-2fce-4020-aef6-36ddbc97f163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-405299081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9910a91c-5ae3-4e2e-9fe3-2573fe696f33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='faa12e0987894793a3b5982f109864b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:36Z,use_quota=True,user_id='76bc8617ed21417bbf3e61911484fcdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d496d-3c82-4d34-b7fe-4d09c6b075a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d496d-3c82-4d34-b7fe-4d09c6b075a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0589cbf2-224e-457b-9b69-99b9032bfcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0589cbf2-224e-457b-9b69-99b9032bfcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9910a91c-5ae3-4e2e-9fe3-2573fe696f33', 'volume_name': 'volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee09e066-5f4b-45e1-84b3-5585de5c45c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee09e066-5f4b-45e1-84b3-5585de5c45c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8cabea-1044-4ef9-9a9e-468b3389ea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Volume 9910a91c-5ae3-4e2e-9fe3-2573fe696f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33', 'volume_size': 1} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-405299081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9910a91c-5ae3-4e2e-9fe3-2573fe696f33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='faa12e0987894793a3b5982f109864b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:36Z,use_quota=True,user_id='76bc8617ed21417bbf3e61911484fcdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Creating volume 9910a91c-5ae3-4e2e-9fe3-2573fe696f33 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:04:36 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:36 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 1073741824 Sep 02 00:04:36 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:36 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf" returned: 0 in 0.466s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ff18594-28cb-4726-b7c1-ac042b670d85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb36313-07e4-4936-9739-3bddcdb7a593]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:36 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 Sep 02 00:04:36 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:37 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 1073741824" returned: 0 in 0.604s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:37 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 Sep 02 00:04:37 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:37 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85" returned: 0 in 0.599s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:37 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf Sep 02 00:04:37 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:37 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8cabea-1044-4ef9-9a9e-468b3389ea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b341cf-aa64-457b-b013-1329c56d52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Volume volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 (9910a91c-5ae3-4e2e-9fe3-2573fe696f33): created successfully Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b341cf-aa64-457b-b013-1329c56d52e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Flow 'volume_create_manager' (1472ccc8-1062-47c6-a36c-cd701c08ae9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-99fc607d-7d0b-4ad4-b01d-03898f196d01 req-067bca82-ad21-4ed6-a8b6-3f85f03c7556 tempest-VolumesGetTestJSON-300256923 None] Created volume successfully. Sep 02 00:04:37 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf" returned: 0 in 0.520s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:37 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf Sep 02 00:04:37 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:38 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85.cd6572ce-beb5-4cf3-b618-90540e2396bf" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-cd6572ce-beb5-4cf3-b618-90540e2396bf" released by "_delete_snapshot" :: held 2.027s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-4ff18594-28cb-4726-b7c1-ac042b670d85" released by "delete_snapshot" :: held 2.053s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Created reservations ['0acfe799-97e0-4d90-82a2-742e8497243a', '36caaccf-67eb-48ac-87a8-915d3f255966', '22a8a696-2b59-4207-84be-02134fb1aa85', '2b39838c-3a4d-457a-b999-3485631bc72b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Delete snapshot completed successfully. Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-cd6572ce-beb5-4cf3-b618-90540e2396bf-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Snapshots deleted, issuing volume delete {{(pid=86591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-4ff18594-28cb-4726-b7c1-ac042b670d85" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-4ff18594-28cb-4726-b7c1-ac042b670d85" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc753c7-d0a1-4978-a4f0-81db0be9fa5b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:38 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 Sep 02 00:04:38 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:38 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85" returned: 0 in 0.427s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:38 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85 Sep 02 00:04:38 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Acquiring lock "cinder-9910a91c-5ae3-4e2e-9fe3-2573fe696f33-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Lock "cinder-9910a91c-5ae3-4e2e-9fe3-2573fe696f33-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:39 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Acquiring lock "cinder-quobyte-9910a91c-5ae3-4e2e-9fe3-2573fe696f33" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4ff18594-28cb-4726-b7c1-ac042b670d85" returned: 0 in 0.318s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-4ff18594-28cb-4726-b7c1-ac042b670d85" released by "delete_volume" :: held 0.823s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Lock "cinder-quobyte-9910a91c-5ae3-4e2e-9fe3-2573fe696f33" acquired by "delete_volume" :: waited 0.040s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c5bf5-33e3-4cc4-acc6-7d854df747b7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Created reservations ['312063c2-7d5e-4a32-b124-3edb97160c05', '3a418bff-f33e-46e0-a13a-1b18689136ff', 'b26b71fa-9b6c-477f-b745-35464943a322', '25f9f788-e6f1-4686-9e59-fbd0e4f08094'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:39 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:39 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:39 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 Sep 02 00:04:39 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:39 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Deleted volume successfully. Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a65df-82f7-4321-a2a6-2533b837a882 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-4ff18594-28cb-4726-b7c1-ac042b670d85-delete_volume" released by "delete_volume" :: held 3.698s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:39 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33" returned: 0 in 0.589s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:39 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33 Sep 02 00:04:39 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:40 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-9910a91c-5ae3-4e2e-9fe3-2573fe696f33" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Lock "cinder-quobyte-9910a91c-5ae3-4e2e-9fe3-2573fe696f33" released by "delete_volume" :: held 0.962s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.quota [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Created reservations ['f2878fc5-249a-4ca5-9b77-802268ba7dca', '47130201-1f11-4ed8-8f41-457333808b82', 'd450d9c0-5677-43f9-ab8a-f2782104025b', '3a9077ca-763f-4a4e-a53b-cebe1257ff75'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:40 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:40 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-2d4eebd2-6bfc-4809-9749-672ddc65af43-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-2d4eebd2-6bfc-4809-9749-672ddc65af43-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:40 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "cinder-quobyte-2d4eebd2-6bfc-4809-9749-672ddc65af43" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.manager [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Deleted volume successfully. Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-2d4eebd2-6bfc-4809-9749-672ddc65af43" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-979776b4-c8a1-4465-bcd0-219541791ab5 req-46361403-890e-4cbc-90c0-f297bfa50fc1 tempest-VolumesGetTestJSON-300256923 None] Lock "cinder-9910a91c-5ae3-4e2e-9fe3-2573fe696f33-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e26e1ac-ff82-4bdd-a507-613c34203b9d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:40 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 Sep 02 00:04:40 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:41 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:41 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43 Sep 02 00:04:41 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:41 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2d4eebd2-6bfc-4809-9749-672ddc65af43" returned: 0 in 0.290s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-quobyte-2d4eebd2-6bfc-4809-9749-672ddc65af43" released by "delete_volume" :: held 0.745s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Created reservations ['2d9223be-746b-4a36-a0df-6659fcca262e', '62b600d9-b4cf-46c1-8722-e901ec5a1cf3', '6a863b0d-f3c9-4973-a8ed-c470ca446a0e', 'a0842dd4-ef05-43ca-9bab-fd8a4bdcbfcb'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:41 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:41 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:41 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Deleted volume successfully. Sep 02 00:04:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4756464e-bb56-475f-9472-728fe2b6fa68 tempest-VolumesDeleteCascade-1057835110 None] Lock "cinder-2d4eebd2-6bfc-4809-9749-672ddc65af43-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Flow 'volume_create_manager' (2e823331-14b6-456e-b37a-26d41e2ba4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a49cd1-ebd5-4fe2-b7bc-bd3ec7d480ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a49cd1-ebd5-4fe2-b7bc-bd3ec7d480ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-782804704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d576c054-1374-487a-b3a6-11d2bf8cb356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba183052723449f8de638c5e1862457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:47Z,use_quota=True,user_id='01835b8bc0ad4e8b96a3bf4f3da44f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14ade96-de04-4e39-928b-c94b20d63fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14ade96-de04-4e39-928b-c94b20d63fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090e861d-cbc9-4306-a0b3-3966a0348377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090e861d-cbc9-4306-a0b3-3966a0348377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd576c054-1374-487a-b3a6-11d2bf8cb356', 'volume_name': 'volume-d576c054-1374-487a-b3a6-11d2bf8cb356', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97959a40-8da8-46d2-a0bf-70fbda3aed48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97959a40-8da8-46d2-a0bf-70fbda3aed48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c03f5c-815e-4149-9ace-f7758b3bca64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Volume d576c054-1374-487a-b3a6-11d2bf8cb356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d576c054-1374-487a-b3a6-11d2bf8cb356', 'volume_size': 1} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-782804704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d576c054-1374-487a-b3a6-11d2bf8cb356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba183052723449f8de638c5e1862457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:47Z,use_quota=True,user_id='01835b8bc0ad4e8b96a3bf4f3da44f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Creating volume d576c054-1374-487a-b3a6-11d2bf8cb356 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:04:47 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:47 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356 1073741824 Sep 02 00:04:47 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:47 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356 1073741824" returned: 0 in 0.540s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:47 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356 Sep 02 00:04:47 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:47 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356" returned: 0 in 0.325s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c03f5c-815e-4149-9ace-f7758b3bca64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d576c054-1374-487a-b3a6-11d2bf8cb356', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6f5bf7-6e1f-40e8-9516-1b700acf4ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Volume volume-d576c054-1374-487a-b3a6-11d2bf8cb356 (d576c054-1374-487a-b3a6-11d2bf8cb356): created successfully Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6f5bf7-6e1f-40e8-9516-1b700acf4ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Flow 'volume_create_manager' (2e823331-14b6-456e-b37a-26d41e2ba4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e6526852-960d-407f-9934-803befec0156 tempest-VolumesTransfersTest-222645138 None] Created volume successfully. Sep 02 00:04:49 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=145,cinder:UPDATE=175,cinder:DELETE=18,cinder:INSERT=36 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:04:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6c545c6a-1876-4826-aefd-27bba26bcca9 tempest-VolumesTransfersTest-1774054378 None] Transfer volume completed successfully. Sep 02 00:04:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Acquiring lock "cinder-d576c054-1374-487a-b3a6-11d2bf8cb356-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Lock "cinder-d576c054-1374-487a-b3a6-11d2bf8cb356-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:50 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=182,cinder:SELECT=153,cinder:INSERT=49,cinder:DELETE=11 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:04:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Acquiring lock "cinder-quobyte-d576c054-1374-487a-b3a6-11d2bf8cb356" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Lock "cinder-quobyte-d576c054-1374-487a-b3a6-11d2bf8cb356" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8df7952-4302-4b65-a539-27c393cadff3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:51 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356 Sep 02 00:04:51 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:51 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356" returned: 0 in 0.463s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:51 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356 Sep 02 00:04:51 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:51 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d576c054-1374-487a-b3a6-11d2bf8cb356" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Lock "cinder-quobyte-d576c054-1374-487a-b3a6-11d2bf8cb356" released by "delete_volume" :: held 0.804s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Created reservations ['145562ce-f110-42ef-8bba-eab3d2ac5ce4', 'a8dfa6e7-58a9-452d-98f8-0ffbea675caa', 'd2c04d80-9490-4b3d-86d3-bc5dd7a18d0f', '8536981b-2b01-46fa-8258-dee9a65177e1'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:51 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:51 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:52 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Deleted volume successfully. Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8e798b44-6617-431d-8e17-27b4d74307f1 tempest-VolumesTransfersTest-1760611959 None] Lock "cinder-d576c054-1374-487a-b3a6-11d2bf8cb356-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Flow 'volume_create_manager' (b0301aaf-84fd-4528-8ddf-abd7a3bf8f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c9f126-0331-4718-99e9-35e06e264e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c9f126-0331-4718-99e9-35e06e264e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-574208794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070be422-7de4-4775-b64f-ca943043a756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba183052723449f8de638c5e1862457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:53Z,use_quota=True,user_id='01835b8bc0ad4e8b96a3bf4f3da44f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252cf947-0c4a-4c1c-8f8b-5200eabd7f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252cf947-0c4a-4c1c-8f8b-5200eabd7f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7aa5256-7654-4e5b-8d6a-a9caaeae209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7aa5256-7654-4e5b-8d6a-a9caaeae209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070be422-7de4-4775-b64f-ca943043a756', 'volume_name': 'volume-070be422-7de4-4775-b64f-ca943043a756', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a25bfe-de19-4209-b644-bff10c708c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a25bfe-de19-4209-b644-bff10c708c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd1d181-50b0-4309-8e35-db2707cea98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Volume 070be422-7de4-4775-b64f-ca943043a756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070be422-7de4-4775-b64f-ca943043a756', 'volume_size': 1} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-574208794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070be422-7de4-4775-b64f-ca943043a756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba183052723449f8de638c5e1862457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:04:53Z,use_quota=True,user_id='01835b8bc0ad4e8b96a3bf4f3da44f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Creating volume 070be422-7de4-4775-b64f-ca943043a756 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:04:52 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:04:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:52 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756 1073741824 Sep 02 00:04:52 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:53 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756 1073741824" returned: 0 in 0.720s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:53 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756 Sep 02 00:04:53 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:53 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756" returned: 0 in 0.347s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:04:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd1d181-50b0-4309-8e35-db2707cea98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070be422-7de4-4775-b64f-ca943043a756', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015ae3c5-ee45-4ac1-8b71-3a722beb785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:04:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Volume volume-070be422-7de4-4775-b64f-ca943043a756 (070be422-7de4-4775-b64f-ca943043a756): created successfully Sep 02 00:04:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015ae3c5-ee45-4ac1-8b71-3a722beb785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:04:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Flow 'volume_create_manager' (b0301aaf-84fd-4528-8ddf-abd7a3bf8f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:04:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-03c8d6c7-f048-424c-939d-0646940a1392 tempest-VolumesTransfersTest-222645138 None] Created volume successfully. Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Acquiring lock "cinder-070be422-7de4-4775-b64f-ca943043a756-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Lock "cinder-070be422-7de4-4775-b64f-ca943043a756-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Acquiring lock "cinder-quobyte-070be422-7de4-4775-b64f-ca943043a756" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Lock "cinder-quobyte-070be422-7de4-4775-b64f-ca943043a756" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd0d519-ec26-467b-98d8-0d29adae5522]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:55 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756 Sep 02 00:04:55 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:55 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756" returned: 0 in 0.411s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:55 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756 Sep 02 00:04:55 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:55 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-070be422-7de4-4775-b64f-ca943043a756" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Lock "cinder-quobyte-070be422-7de4-4775-b64f-ca943043a756" released by "delete_volume" :: held 0.764s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Created reservations ['fcacc63e-38a5-4e41-9a6f-392cf70bddde', 'c0ecf528-9015-4838-be93-d7503096a449', '2fa03a96-6c44-4d8f-8c52-ebb3c3d525e3', 'b37bb27d-a0ed-4b65-aa5a-fc01ef32e0c8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:04:56 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:04:56 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:04:56 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.434s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:04:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Deleted volume successfully. Sep 02 00:04:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b564b44b-f73b-4cfb-a440-7abaa6715a32 tempest-VolumesTransfersTest-1760611959 None] Lock "cinder-070be422-7de4-4775-b64f-ca943043a756-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Flow 'volume_create_manager' (804bf74b-5207-48ba-b765-b95604dfbba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116a7159-53ed-41bd-b81b-4a09bee64341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116a7159-53ed-41bd-b81b-4a09bee64341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-666598590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edd6bc5-53f1-47d7-a742-5518e3fa2d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914376497f464e4a8454e64ca55361ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:04Z,use_quota=True,user_id='336ae9faa01f4618a30a8f1085ee4c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8c15d8-05e8-4306-a494-326bac5403d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8c15d8-05e8-4306-a494-326bac5403d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32242b74-71f3-4335-996d-817b4584116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32242b74-71f3-4335-996d-817b4584116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edd6bc5-53f1-47d7-a742-5518e3fa2d90', 'volume_name': 'volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169a5ba0-c4e3-4a6d-81ff-2ca8c8076ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169a5ba0-c4e3-4a6d-81ff-2ca8c8076ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07659605-a34a-4741-af02-dacd09e4993c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Volume 2edd6bc5-53f1-47d7-a742-5518e3fa2d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90', 'volume_size': 1} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-666598590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edd6bc5-53f1-47d7-a742-5518e3fa2d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914376497f464e4a8454e64ca55361ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:04Z,use_quota=True,user_id='336ae9faa01f4618a30a8f1085ee4c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Creating volume 2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:04 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:04 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 1073741824 Sep 02 00:05:04 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:05 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 1073741824" returned: 0 in 1.093s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:05 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 Sep 02 00:05:05 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:06 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90" returned: 0 in 0.379s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07659605-a34a-4741-af02-dacd09e4993c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b24b89f-8d2c-4844-8b6e-02dce76750df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Volume volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 (2edd6bc5-53f1-47d7-a742-5518e3fa2d90): created successfully Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b24b89f-8d2c-4844-8b6e-02dce76750df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Flow 'volume_create_manager' (804bf74b-5207-48ba-b765-b95604dfbba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d2f802af-0c37-4890-a2d4-39d6f3c595aa tempest-VolumesCloneTest-1146753041 None] Created volume successfully. Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:06 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:05:06 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:07 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.509s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Flow 'volume_create_manager' (5e2fa92d-f613-411a-bfe0-6e81af86d57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f2bbfb-ffc0-4e79-95aa-6114928a34b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f2bbfb-ffc0-4e79-95aa-6114928a34b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2110520664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d2ff93-f47d-4a99-8eae-79eff8976d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914376497f464e4a8454e64ca55361ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2edd6bc5-53f1-47d7-a742-5518e3fa2d90,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:07Z,use_quota=True,user_id='336ae9faa01f4618a30a8f1085ee4c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7e1e90-4424-4ca2-9921-6974d5997829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7e1e90-4424-4ca2-9921-6974d5997829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62008481-4bc8-49b6-96c7-10ffe5bf5a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62008481-4bc8-49b6-96c7-10ffe5bf5a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '76d2ff93-f47d-4a99-8eae-79eff8976d3b', 'volume_name': 'volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b', 'volume_size': 2, 'source_volid': '2edd6bc5-53f1-47d7-a742-5518e3fa2d90', 'source_volstatus': 'available'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e0d021-a700-4dc2-a105-928b30ce4a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e0d021-a700-4dc2-a105-928b30ce4a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d46456-0bae-4b71-b2dd-76e25e4dda7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Volume 76d2ff93-f47d-4a99-8eae-79eff8976d3b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b', 'volume_size': 2, 'source_volid': '2edd6bc5-53f1-47d7-a742-5518e3fa2d90', 'source_volstatus': 'available'} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:07 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Cloning volume 2edd6bc5-53f1-47d7-a742-5518e3fa2d90 to volume 76d2ff93-f47d-4a99-8eae-79eff8976d3b Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Creating offline snapshot 12a378b6-e255-464a-9b7f-2c94bde63365 of volume 2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c70adbf-97b7-4239-9150-3ea85f957fc6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:07 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 Sep 02 00:05:07 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:07 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90" returned: 0 in 0.501s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:07 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 1G Sep 02 00:05:07 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:08 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 1G" returned: 0 in 0.606s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:08 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 Sep 02 00:05:08 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:08 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:08 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 is being set with open permissions: ugo+rw Sep 02 00:05:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:08 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 Sep 02 00:05:08 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:09 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365" returned: 0 in 0.313s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:09 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.info Sep 02 00:05:09 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:09 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.info" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:09 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.info is being set with open permissions: ugo+rw Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:09 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.info Sep 02 00:05:09 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Flow 'volume_create_manager' (530adf77-4423-4a83-a4e0-ef2913f15fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7ab3a3-0cc3-4195-8b02-4dedb63d52c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:09 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.info" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Acquiring lock "cinder-quobyte-76d2ff93-f47d-4a99-8eae-79eff8976d3b" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7ab3a3-0cc3-4195-8b02-4dedb63d52c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-494216798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7455698c-003c-4379-b778-2b89b9f9e807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd674d846b57430788ce93de9fa7f14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:10Z,use_quota=True,user_id='e8c214c0f62f478e9542e15ba1be750a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fd3a28-1251-4d95-aad5-adbbb37dc3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fd3a28-1251-4d95-aad5-adbbb37dc3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff6c883-a87e-4f90-8bc9-edd88abc8adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff6c883-a87e-4f90-8bc9-edd88abc8adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7455698c-003c-4379-b778-2b89b9f9e807', 'volume_name': 'volume-7455698c-003c-4379-b778-2b89b9f9e807', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1884704-8446-4e5d-ba64-3a3aa3a06fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1884704-8446-4e5d-ba64-3a3aa3a06fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec1673d-87de-4763-a6db-356c67d461a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Volume 7455698c-003c-4379-b778-2b89b9f9e807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7455698c-003c-4379-b778-2b89b9f9e807', 'volume_size': 1} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Lock "cinder-quobyte-76d2ff93-f47d-4a99-8eae-79eff8976d3b" acquired by "_copy_volume_from_snapshot" :: waited 0.079s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] snapshot: 12a378b6-e255-464a-9b7f-2c94bde63365, volume: 76d2ff93-f47d-4a99-8eae-79eff8976d3b, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b70a4d-411a-4e38-8cec-0edf0c8a9f63]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:10 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 Sep 02 00:05:10 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:10 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365" returned: 0 in 0.437s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f3ab52-4ef3-496d-b71c-4d7b5d408f01]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:10 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 Sep 02 00:05:10 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:10 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90" returned: 0 in 0.371s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:05:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:10 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b Sep 02 00:05:10 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:16 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b" returned: 0 in 5.520s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:05:16 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Converted 1024.00 MB image at 185.46 MB/s Sep 02 00:05:16 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b is being set with open permissions: ugo+rw Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:16 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b Sep 02 00:05:16 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:16 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b" returned: 0 in 0.346s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Lock "cinder-quobyte-76d2ff93-f47d-4a99-8eae-79eff8976d3b" released by "_copy_volume_from_snapshot" :: held 6.758s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Acquiring lock "cinder-quobyte-12a378b6-e255-464a-9b7f-2c94bde63365" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Lock "cinder-quobyte-12a378b6-e255-464a-9b7f-2c94bde63365" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Deleting offline snapshot 12a378b6-e255-464a-9b7f-2c94bde63365 of volume 2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] snapshot_file for this snap is: volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0578f66-2e06-48ea-a33f-973ad8c238ed]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:16 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 Sep 02 00:05:16 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:17 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365" returned: 0 in 0.441s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:05:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9dd18c-ce07-4d11-b519-58915c3db2c9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:17 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 Sep 02 00:05:17 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:18 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90" returned: 0 in 0.688s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:18 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 Sep 02 00:05:18 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:18 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365" returned: 0 in 0.415s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:18 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365 Sep 02 00:05:18 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:18 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90.12a378b6-e255-464a-9b7f-2c94bde63365" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Lock "cinder-quobyte-12a378b6-e255-464a-9b7f-2c94bde63365" released by "_delete_snapshot" :: held 1.942s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.501s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.814s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-494216798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7455698c-003c-4379-b778-2b89b9f9e807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd674d846b57430788ce93de9fa7f14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:10Z,use_quota=True,user_id='e8c214c0f62f478e9542e15ba1be750a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Creating volume 7455698c-003c-4379-b778-2b89b9f9e807 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:18 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:18 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807 1073741824 Sep 02 00:05:18 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d46456-0bae-4b71-b2dd-76e25e4dda7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b', 'volume_size': 2, 'source_volid': '2edd6bc5-53f1-47d7-a742-5518e3fa2d90', 'source_volstatus': 'available'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d078eab5-dc85-49a0-970b-7d437628e38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Volume volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b (76d2ff93-f47d-4a99-8eae-79eff8976d3b): created successfully Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d078eab5-dc85-49a0-970b-7d437628e38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Flow 'volume_create_manager' (5e2fa92d-f613-411a-bfe0-6e81af86d57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-efa4ff3b-08d8-4a56-8422-0ddfb681919c tempest-VolumesCloneTest-1146753041 None] Created volume successfully. Sep 02 00:05:19 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807 1073741824" returned: 0 in 0.659s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:19 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807 Sep 02 00:05:19 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Acquiring lock "cinder-76d2ff93-f47d-4a99-8eae-79eff8976d3b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Lock "cinder-76d2ff93-f47d-4a99-8eae-79eff8976d3b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:19 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec1673d-87de-4763-a6db-356c67d461a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7455698c-003c-4379-b778-2b89b9f9e807', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f071e702-a610-420c-a25b-e1029b72604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Volume volume-7455698c-003c-4379-b778-2b89b9f9e807 (7455698c-003c-4379-b778-2b89b9f9e807): created successfully Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f071e702-a610-420c-a25b-e1029b72604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Flow 'volume_create_manager' (530adf77-4423-4a83-a4e0-ef2913f15fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Acquiring lock "cinder-quobyte-76d2ff93-f47d-4a99-8eae-79eff8976d3b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5c9a30cc-a588-4447-a88f-06e25e7e3838 tempest-TestMinimumBasicScenario-1150868788 None] Created volume successfully. Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Lock "cinder-quobyte-76d2ff93-f47d-4a99-8eae-79eff8976d3b" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[66237115-72c6-4d95-930e-15b99882cb0c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:20 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b Sep 02 00:05:20 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:20 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:20 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b Sep 02 00:05:20 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:20 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-76d2ff93-f47d-4a99-8eae-79eff8976d3b" returned: 0 in 0.271s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Lock "cinder-quobyte-76d2ff93-f47d-4a99-8eae-79eff8976d3b" released by "delete_volume" :: held 0.777s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Created reservations ['a7e0b677-eecd-4a12-8466-1c5ecd90d72f', 'aa9cb63d-0ccd-4eaa-bf02-2de8cee11c50', '99301a20-f0f2-4528-9ad0-8427bfd68626', 'bc7daf33-ecae-4a49-87d3-a78e89e14ee8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:20 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:05:20 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Acquiring lock "cinder-2edd6bc5-53f1-47d7-a742-5518e3fa2d90-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Lock "cinder-2edd6bc5-53f1-47d7-a742-5518e3fa2d90-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Acquiring lock "cinder-quobyte-2edd6bc5-53f1-47d7-a742-5518e3fa2d90" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Lock "cinder-quobyte-2edd6bc5-53f1-47d7-a742-5518e3fa2d90" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:21 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.397s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:05:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Deleted volume successfully. Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf27b78c-58a9-47ab-a114-1131d89fa89a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc6bb2fe-1180-482b-9300-0c987220cb17 tempest-VolumesCloneTest-1146753041 None] Lock "cinder-76d2ff93-f47d-4a99-8eae-79eff8976d3b-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:21 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 Sep 02 00:05:21 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:21 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90" returned: 0 in 0.444s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:21 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90 Sep 02 00:05:21 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:22 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2edd6bc5-53f1-47d7-a742-5518e3fa2d90" returned: 0 in 0.341s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-d5035bec-4f28-4522-b37f-4244b2b3f36d req-761d2cab-1217-4b19-85b0-b476e51cbae1 tempest-TestMinimumBasicScenario-1150868788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-d5035bec-4f28-4522-b37f-4244b2b3f36d req-761d2cab-1217-4b19-85b0-b476e51cbae1 tempest-TestMinimumBasicScenario-1150868788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Lock "cinder-quobyte-2edd6bc5-53f1-47d7-a742-5518e3fa2d90" released by "delete_volume" :: held 0.876s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-d5035bec-4f28-4522-b37f-4244b2b3f36d req-761d2cab-1217-4b19-85b0-b476e51cbae1 tempest-TestMinimumBasicScenario-1150868788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-d5035bec-4f28-4522-b37f-4244b2b3f36d req-761d2cab-1217-4b19-85b0-b476e51cbae1 tempest-TestMinimumBasicScenario-1150868788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-7455698c-003c-4379-b778-2b89b9f9e807', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df633eb5-a83c-4de0-ad8f-a953cf5b148b', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Created reservations ['fc06d63e-14c9-4c51-b7ce-7fc21902e855', '86484d14-6d7a-4489-bf4b-d979b3be85c9', '5a77d7b8-110f-4e40-9646-c383cc6fe277', '19ca6595-3c18-4cdf-a688-7f6d641a4b7d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:05:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-d5035bec-4f28-4522-b37f-4244b2b3f36d req-761d2cab-1217-4b19-85b0-b476e51cbae1 tempest-TestMinimumBasicScenario-1150868788 None] attachment_update completed successfully. Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:22 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:05:22 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:22 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.312s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:05:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Deleted volume successfully. Sep 02 00:05:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e2403882-1d88-4ae6-afb4-a7c450bff0b4 tempest-VolumesCloneTest-1146753041 None] Lock "cinder-2edd6bc5-53f1-47d7-a742-5518e3fa2d90-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Flow 'volume_create_manager' (07b48ee5-464a-482d-8f8c-05f26e1f27e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce793eae-1e14-43a8-8446-0c591bed634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce793eae-1e14-43a8-8446-0c591bed634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2020833212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1e3698-eea5-4b1b-9e66-02d9c40b4c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e464bca6924bc7b76df414d714ad03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:23Z,use_quota=True,user_id='902fb892adcc433e94fde7748ce79c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013e50bc-c076-4965-92a0-9a3ad2e5d6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013e50bc-c076-4965-92a0-9a3ad2e5d6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cd30f7-b44f-4e06-80b0-5828b90c076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cd30f7-b44f-4e06-80b0-5828b90c076d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1e3698-eea5-4b1b-9e66-02d9c40b4c13', 'volume_name': 'volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd48cf6-88ac-4ed9-b51c-37acca50544e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd48cf6-88ac-4ed9-b51c-37acca50544e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d006f452-afbd-4ee2-a449-422cda5f2edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Volume 4a1e3698-eea5-4b1b-9e66-02d9c40b4c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13', 'volume_size': 1} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2020833212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1e3698-eea5-4b1b-9e66-02d9c40b4c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e464bca6924bc7b76df414d714ad03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:23Z,use_quota=True,user_id='902fb892adcc433e94fde7748ce79c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Creating volume 4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:23 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:23 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 1073741824 Sep 02 00:05:23 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:23 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 1073741824" returned: 0 in 0.500s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:23 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 Sep 02 00:05:23 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:24 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13" returned: 0 in 0.308s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d006f452-afbd-4ee2-a449-422cda5f2edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbeca81-ef60-4ee8-804c-9706005d2442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Volume volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 (4a1e3698-eea5-4b1b-9e66-02d9c40b4c13): created successfully Sep 02 00:05:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbeca81-ef60-4ee8-804c-9706005d2442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Flow 'volume_create_manager' (07b48ee5-464a-482d-8f8c-05f26e1f27e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3e4b53a3-ba10-45e4-b36f-7481cca374f9 tempest-VolumeQuotasAdminTestJSON-583481523 None] Created volume successfully. Sep 02 00:05:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Acquiring lock "cinder-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "cinder-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Acquiring lock "cinder-quobyte-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "cinder-quobyte-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f09f45-7550-4875-bbf8-409fc693734c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:25 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 Sep 02 00:05:25 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:25 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13" returned: 0 in 0.391s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:25 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13 Sep 02 00:05:25 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:26 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13" returned: 0 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "cinder-quobyte-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13" released by "delete_volume" :: held 0.772s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Flow 'volume_create_manager' (19dbbd78-b963-4c76-8517-895f8ceefb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad022d5-0085-4f2d-9631-db25381d4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad022d5-0085-4f2d-9631-db25381d4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1451588601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d7c1f6-0159-4d49-914e-ecd9fb343646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7809f42a6e7f422195a9b88972d55a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:26Z,use_quota=True,user_id='b875e029336045e3a589632b38be1829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd6da3a-0b51-40b7-bc07-d698cf4764db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd6da3a-0b51-40b7-bc07-d698cf4764db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5cc32f-c515-49ca-a7cd-846109a90986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5cc32f-c515-49ca-a7cd-846109a90986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d7c1f6-0159-4d49-914e-ecd9fb343646', 'volume_name': 'volume-13d7c1f6-0159-4d49-914e-ecd9fb343646', 'volume_size': 2}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3ec069-4f4c-42b6-a8e5-d4f1a4f7a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3ec069-4f4c-42b6-a8e5-d4f1a4f7a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9badc997-2c63-4bdc-a2a9-082f2d4c4ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Volume 13d7c1f6-0159-4d49-914e-ecd9fb343646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d7c1f6-0159-4d49-914e-ecd9fb343646', 'volume_size': 2} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1451588601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d7c1f6-0159-4d49-914e-ecd9fb343646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7809f42a6e7f422195a9b88972d55a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:26Z,use_quota=True,user_id='b875e029336045e3a589632b38be1829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Creating volume 13d7c1f6-0159-4d49-914e-ecd9fb343646 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:26 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 2147483648 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:26 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 2147483648 Sep 02 00:05:26 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Created reservations ['08e6d1cb-bb0a-4e9e-af41-0c128b4c6d30', '862ad536-0ba5-4c1c-a5f7-e65441e07aa7', '816c837b-0c4c-4540-87f2-d00891559954', '89b849db-8cf0-4dcc-bc0b-18e62a614867'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:26 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:05:26 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:26 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.316s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:05:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Deleted volume successfully. Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-127d5e0f-2cc8-4888-bbf8-e65b2de6bb7e tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "cinder-4a1e3698-eea5-4b1b-9e66-02d9c40b4c13-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:26 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 2147483648" returned: 0 in 0.746s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:27 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 Sep 02 00:05:27 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Flow 'volume_create_manager' (fbbcbbe5-a786-47c3-960b-38881e28196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d848fd-dc64-4d29-b80a-c410ec80e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d848fd-dc64-4d29-b80a-c410ec80e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1174785120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59179a08-6fa0-4d7f-97c7-ab47f56c6902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e464bca6924bc7b76df414d714ad03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:27Z,use_quota=True,user_id='902fb892adcc433e94fde7748ce79c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af992688-0f02-4a41-b6f8-01d6e3ca6a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af992688-0f02-4a41-b6f8-01d6e3ca6a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ef707e-0f86-481a-b8ce-e2362fd33834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ef707e-0f86-481a-b8ce-e2362fd33834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59179a08-6fa0-4d7f-97c7-ab47f56c6902', 'volume_name': 'volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cf0730-c6d1-43bd-8499-a6c72bf0fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cf0730-c6d1-43bd-8499-a6c72bf0fe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073cd1de-8629-4b94-956a-2011db099ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:27 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Volume 59179a08-6fa0-4d7f-97c7-ab47f56c6902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902', 'volume_size': 1} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:27 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646" returned: 0 in 0.407s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.118s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1174785120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59179a08-6fa0-4d7f-97c7-ab47f56c6902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e464bca6924bc7b76df414d714ad03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:27Z,use_quota=True,user_id='902fb892adcc433e94fde7748ce79c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Creating volume 59179a08-6fa0-4d7f-97c7-ab47f56c6902 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:27 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:27 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 1073741824 Sep 02 00:05:27 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9badc997-2c63-4bdc-a2a9-082f2d4c4ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d7c1f6-0159-4d49-914e-ecd9fb343646', 'volume_size': 2}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a3b04d-7bd9-4e76-8011-1e7a7273b3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:27 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Volume volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 (13d7c1f6-0159-4d49-914e-ecd9fb343646): created successfully Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a3b04d-7bd9-4e76-8011-1e7a7273b3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Flow 'volume_create_manager' (19dbbd78-b963-4c76-8517-895f8ceefb1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-64863882-4b28-4ce7-9717-ee498e8b494e tempest-VolumesCloneNegativeTest-1960853604 None] Created volume successfully. Sep 02 00:05:28 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 1073741824" returned: 0 in 0.703s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:28 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 Sep 02 00:05:28 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Acquiring lock "cinder-13d7c1f6-0159-4d49-914e-ecd9fb343646-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Lock "cinder-13d7c1f6-0159-4d49-914e-ecd9fb343646-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Acquiring lock "cinder-quobyte-13d7c1f6-0159-4d49-914e-ecd9fb343646" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Lock "cinder-quobyte-13d7c1f6-0159-4d49-914e-ecd9fb343646" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:28 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902" returned: 0 in 0.526s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073cd1de-8629-4b94-956a-2011db099ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (defa5c45-c128-4245-90d1-5a0464c25c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[122bba7f-8e87-45a1-b88e-c3d44c054c0a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:28 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Volume volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 (59179a08-6fa0-4d7f-97c7-ab47f56c6902): created successfully Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (defa5c45-c128-4245-90d1-5a0464c25c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Flow 'volume_create_manager' (fbbcbbe5-a786-47c3-960b-38881e28196a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b2273687-85f5-4d2d-938b-9c7b7c6822be tempest-VolumeQuotasAdminTestJSON-583481523 None] Created volume successfully. Sep 02 00:05:28 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 Sep 02 00:05:28 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:29 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646" returned: 0 in 0.418s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:29 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646 Sep 02 00:05:29 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:29 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-13d7c1f6-0159-4d49-914e-ecd9fb343646" returned: 0 in 0.360s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Lock "cinder-quobyte-13d7c1f6-0159-4d49-914e-ecd9fb343646" released by "delete_volume" :: held 0.892s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Created reservations ['68a60046-f36a-4900-b082-ba826f6191c4', 'e0621c11-2031-4ad0-8eb8-e50653d82b09', '2c1b9648-2008-4b3d-90c2-5c60cd119d09', 'da7d80ca-ab23-4118-92e0-2a9f0619b267'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:29 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:05:29 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:30 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.353s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:30 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:05:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Deleted volume successfully. Sep 02 00:05:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fe44c7a1-e875-4126-9375-85b9ba663cc8 tempest-VolumeQuotasAdminTestJSON-445958176 None] Transfer volume completed successfully. Sep 02 00:05:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-463da317-f5d8-4298-a7ca-d37a3b2c8025 tempest-VolumesCloneNegativeTest-1960853604 None] Lock "cinder-13d7c1f6-0159-4d49-914e-ecd9fb343646-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Acquiring lock "cinder-59179a08-6fa0-4d7f-97c7-ab47f56c6902-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Lock "cinder-59179a08-6fa0-4d7f-97c7-ab47f56c6902-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Acquiring lock "cinder-quobyte-59179a08-6fa0-4d7f-97c7-ab47f56c6902" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Lock "cinder-quobyte-59179a08-6fa0-4d7f-97c7-ab47f56c6902" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[de22a42c-2a31-4d7d-94ba-3b3cc1ef59a0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:31 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 Sep 02 00:05:31 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:31 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:31 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902 Sep 02 00:05:31 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:31 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-59179a08-6fa0-4d7f-97c7-ab47f56c6902" returned: 0 in 0.329s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Lock "cinder-quobyte-59179a08-6fa0-4d7f-97c7-ab47f56c6902" released by "delete_volume" :: held 0.831s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:31 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Created reservations ['8b5b57df-9e20-4ba7-99db-9f7b77b981f4', 'f827ed38-afa1-41e6-96b6-3b3d3a8dfb56', 'aaaa2aa7-5ab5-485a-9e36-6e6ef47a9fa8', '50d307c0-9995-400a-b39b-27870fb89beb'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:05:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:32 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:05:32 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:32 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.359s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:32 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:05:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Deleted volume successfully. Sep 02 00:05:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37e643d4-d764-40b1-a3e8-a363be6acf34 tempest-VolumeQuotasAdminTestJSON-1741042882 None] Lock "cinder-59179a08-6fa0-4d7f-97c7-ab47f56c6902-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Flow 'volume_create_manager' (8b384eeb-7ace-4b0b-92c7-c8669c435670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c47979-44f8-4169-99ce-2763bfa05e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c47979-44f8-4169-99ce-2763bfa05e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2001030647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea778812-220f-4c7d-9d09-e71487911260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d73357ac2545e986e3f65b38b969a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:40Z,use_quota=True,user_id='2a51b27fe4734129abfb228ca6b35423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4871c7fd-2405-4b4b-8e86-dce301a1d520),volume_type_id=4871c7fd-2405-4b4b-8e86-dce301a1d520)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb531d10-d4bf-45c8-bdf0-52eb4c096fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb531d10-d4bf-45c8-bdf0-52eb4c096fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f809a7-3c2e-4b0c-a899-caece7b462e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f809a7-3c2e-4b0c-a899-caece7b462e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea778812-220f-4c7d-9d09-e71487911260', 'volume_name': 'volume-ea778812-220f-4c7d-9d09-e71487911260', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373b4e3d-30b4-4813-abee-117e64433e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373b4e3d-30b4-4813-abee-117e64433e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2c69da-e05d-4ab2-b850-24490c9cd97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Volume ea778812-220f-4c7d-9d09-e71487911260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea778812-220f-4c7d-9d09-e71487911260', 'volume_size': 1} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2001030647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea778812-220f-4c7d-9d09-e71487911260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d73357ac2545e986e3f65b38b969a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:40Z,use_quota=True,user_id='2a51b27fe4734129abfb228ca6b35423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4871c7fd-2405-4b4b-8e86-dce301a1d520),volume_type_id=4871c7fd-2405-4b4b-8e86-dce301a1d520)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Creating volume ea778812-220f-4c7d-9d09-e71487911260 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:40 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:40 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260 1073741824 Sep 02 00:05:40 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:40 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260 1073741824" returned: 0 in 0.528s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:41 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260 Sep 02 00:05:41 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:41 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260" returned: 0 in 0.311s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2c69da-e05d-4ab2-b850-24490c9cd97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea778812-220f-4c7d-9d09-e71487911260', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfc5c36-3f59-45d1-b7d8-5add066998e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Volume volume-ea778812-220f-4c7d-9d09-e71487911260 (ea778812-220f-4c7d-9d09-e71487911260): created successfully Sep 02 00:05:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfc5c36-3f59-45d1-b7d8-5add066998e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Flow 'volume_create_manager' (8b384eeb-7ace-4b0b-92c7-c8669c435670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-96f6c9e4-e0d3-455d-b0ce-e10f9e754df9 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Created volume successfully. Sep 02 00:05:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6d62538d-f1a4-4879-b21c-58c907dd3f47 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6d62538d-f1a4-4879-b21c-58c907dd3f47 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6d62538d-f1a4-4879-b21c-58c907dd3f47 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6d62538d-f1a4-4879-b21c-58c907dd3f47 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6d62538d-f1a4-4879-b21c-58c907dd3f47 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6d62538d-f1a4-4879-b21c-58c907dd3f47 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:42 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:05:42 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:43 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6d62538d-f1a4-4879-b21c-58c907dd3f47 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.360s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:43 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6d62538d-f1a4-4879-b21c-58c907dd3f47 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:05:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6d62538d-f1a4-4879-b21c-58c907dd3f47 tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Retype volume completed successfully. Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (6bdc9e55-21a8-4349-83e3-18158d5af2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc90e1d-3243-4a71-b786-eca5c6fc6fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Acquiring lock "cinder-ea778812-220f-4c7d-9d09-e71487911260-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc90e1d-3243-4a71-b786-eca5c6fc6fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-366238370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4314d7-1daa-494d-b6d8-fb09b43d76ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0a05fb8f9410b8cc65f5159781a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:44Z,use_quota=True,user_id='e99cc073b89b4cd589ad30cadbe596b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fb84d5-dc83-40f1-aa33-44daeae0af7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fb84d5-dc83-40f1-aa33-44daeae0af7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31327563-1136-4c52-8ba7-d9891e6242d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31327563-1136-4c52-8ba7-d9891e6242d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4314d7-1daa-494d-b6d8-fb09b43d76ea', 'volume_name': 'volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfab1f8-6cc7-40cc-9f40-6e63206b3634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfab1f8-6cc7-40cc-9f40-6e63206b3634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77eaabd-4b48-44dc-a7cb-4f997a29d5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:44 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Volume df4314d7-1daa-494d-b6d8-fb09b43d76ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea', 'volume_size': 1} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-366238370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4314d7-1daa-494d-b6d8-fb09b43d76ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0a05fb8f9410b8cc65f5159781a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:44Z,use_quota=True,user_id='e99cc073b89b4cd589ad30cadbe596b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Creating volume df4314d7-1daa-494d-b6d8-fb09b43d76ea {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:44 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "cinder-ea778812-220f-4c7d-9d09-e71487911260-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:44 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea 1073741824 Sep 02 00:05:44 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Acquiring lock "cinder-quobyte-ea778812-220f-4c7d-9d09-e71487911260" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "cinder-quobyte-ea778812-220f-4c7d-9d09-e71487911260" acquired by "delete_volume" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dd8d36-d773-4a12-935d-7f5bedbe1cff]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:44 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260 Sep 02 00:05:44 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:44 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea 1073741824" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:44 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:44 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea Sep 02 00:05:44 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260" returned: 0 in 0.409s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:44 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260 Sep 02 00:05:44 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:44 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea" returned: 0 in 0.253s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77eaabd-4b48-44dc-a7cb-4f997a29d5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:45 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c71796-04ae-4036-81be-7b8732dd93bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea778812-220f-4c7d-9d09-e71487911260" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "cinder-quobyte-ea778812-220f-4c7d-9d09-e71487911260" released by "delete_volume" :: held 0.730s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:45 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Volume volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea (df4314d7-1daa-494d-b6d8-fb09b43d76ea): created successfully Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c71796-04ae-4036-81be-7b8732dd93bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (6bdc9e55-21a8-4349-83e3-18158d5af2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-935c10bd-5fbc-4581-98fd-f816f72da0a9 tempest-VolumesSnapshotTestJSON-414488679 None] Created volume successfully. Sep 02 00:05:45 devstack cinder-volume[86591]: WARNING cinder.quota [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:05:45 devstack cinder-volume[86591]: WARNING cinder.quota [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Created reservations ['c22d3d40-e5b6-4661-a5ae-51df61c442a4', 'b7e94389-168c-4093-a279-06162998a05e', '9555c474-078b-4fd7-8ee9-5808c578d0e2', 'cdceb520-62ee-4ffc-a8a5-497a9acc9407'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:45 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:05:45 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:45 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.310s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:05:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Deleted volume successfully. Sep 02 00:05:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-273ff344-5673-429a-adf7-56f566332b3a tempest-VolumeRetypeWithoutMigrationTest-1921468728 None] Lock "cinder-ea778812-220f-4c7d-9d09-e71487911260-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Creating offline snapshot d7efc36b-3c1b-4476-a262-64def52fca88 of volume df4314d7-1daa-494d-b6d8-fb09b43d76ea {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:05:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecba23c1-4763-4877-ae1d-cc7bf0aa76f1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:47 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea Sep 02 00:05:47 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:47 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea" returned: 0 in 0.452s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:47 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 1G Sep 02 00:05:47 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:47 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 1G" returned: 0 in 0.493s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:47 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 Sep 02 00:05:47 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:48 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88" returned: 0 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:48 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 is being set with open permissions: ugo+rw Sep 02 00:05:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:48 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 Sep 02 00:05:48 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:48 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:48 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.info Sep 02 00:05:48 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:48 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.info" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:48 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.info is being set with open permissions: ugo+rw Sep 02 00:05:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:48 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.info Sep 02 00:05:48 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:49 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.info" returned: 0 in 0.304s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-704bbd31-091d-4339-9ce8-bf63be598c34 tempest-VolumesSnapshotTestJSON-414488679 None] Create snapshot completed successfully Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-d7efc36b-3c1b-4476-a262-64def52fca88-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-d7efc36b-3c1b-4476-a262-64def52fca88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=104,cinder:SELECT=79,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-df4314d7-1daa-494d-b6d8-fb09b43d76ea" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-df4314d7-1daa-494d-b6d8-fb09b43d76ea" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-d7efc36b-3c1b-4476-a262-64def52fca88" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-d7efc36b-3c1b-4476-a262-64def52fca88" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Deleting offline snapshot d7efc36b-3c1b-4476-a262-64def52fca88 of volume df4314d7-1daa-494d-b6d8-fb09b43d76ea {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] snapshot_file for this snap is: volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf1bd7b-0d10-4036-acf2-4663c59e8398]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:50 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 Sep 02 00:05:50 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:50 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec455570-0259-448d-a32b-655d0940d645]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:50 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea Sep 02 00:05:50 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:51 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea" returned: 0 in 0.436s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:51 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 Sep 02 00:05:51 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Flow 'volume_create_manager' (cea3a551-1f7c-4e15-8927-10232700c48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ea56e2-9d12-4cf4-a19b-6dd09d40a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ea56e2-9d12-4cf4-a19b-6dd09d40a9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2130202882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a085ef-94df-4405-b911-27b4b7982397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66984865ec4ceb9589d7f105cbd16e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:51Z,use_quota=True,user_id='5ecf691bee504fbdb54cebdfbaa9e23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8ddacf-c333-45e8-8995-77d7ed4096ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8ddacf-c333-45e8-8995-77d7ed4096ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1751ed9f-6d91-450f-8536-b8b1d9b99367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1751ed9f-6d91-450f-8536-b8b1d9b99367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a085ef-94df-4405-b911-27b4b7982397', 'volume_name': 'volume-04a085ef-94df-4405-b911-27b4b7982397', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef466c4d-9520-45ab-bafb-f0f99e9fb9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef466c4d-9520-45ab-bafb-f0f99e9fb9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2f17cc-0dd4-447a-9558-019ac58def5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Volume 04a085ef-94df-4405-b911-27b4b7982397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a085ef-94df-4405-b911-27b4b7982397', 'volume_size': 1} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2130202882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a085ef-94df-4405-b911-27b4b7982397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66984865ec4ceb9589d7f105cbd16e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:51Z,use_quota=True,user_id='5ecf691bee504fbdb54cebdfbaa9e23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Creating volume 04a085ef-94df-4405-b911-27b4b7982397 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:51 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:51 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397 1073741824 Sep 02 00:05:51 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:51 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88" returned: 0 in 0.373s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:51 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88 Sep 02 00:05:51 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:51 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea.d7efc36b-3c1b-4476-a262-64def52fca88" returned: 0 in 0.253s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=90,cinder:INSERT=17,cinder:UPDATE=97,cinder:DELETE=10 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-d7efc36b-3c1b-4476-a262-64def52fca88" released by "_delete_snapshot" :: held 1.558s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-df4314d7-1daa-494d-b6d8-fb09b43d76ea" released by "delete_snapshot" :: held 1.588s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:51 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397 1073741824" returned: 0 in 0.498s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:52 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Created reservations ['e1393bf2-0e3e-4508-94e1-af212a05b4bb', '5b087001-498e-439c-b80a-a98d346cf894', '089c7553-d3a5-448e-a1cb-b6f77c8b7967', 'c81d8bf3-8e54-483c-9936-c3a549ec736d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:05:52 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397 Sep 02 00:05:52 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Delete snapshot completed successfully. Sep 02 00:05:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-06649d17-3a9f-4f73-aef2-831543e69af9 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-d7efc36b-3c1b-4476-a262-64def52fca88-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:05:52 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2f17cc-0dd4-447a-9558-019ac58def5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a085ef-94df-4405-b911-27b4b7982397', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f934bf41-6ec1-4f05-a4e6-013568505dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Volume volume-04a085ef-94df-4405-b911-27b4b7982397 (04a085ef-94df-4405-b911-27b4b7982397): created successfully Sep 02 00:05:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f934bf41-6ec1-4f05-a4e6-013568505dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Flow 'volume_create_manager' (cea3a551-1f7c-4e15-8927-10232700c48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-caea9195-340a-48d8-a215-64b8afbb0161 tempest-VolumesListAdminTestJSON-1363955559 None] Created volume successfully. Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (e6dd675c-f420-4158-82df-c2ef31e9dc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed037b-c98f-4cdf-af10-2861ae221566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed037b-c98f-4cdf-af10-2861ae221566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1372033866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6af6b78-b845-4863-bcc2-78710f78ec61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0a05fb8f9410b8cc65f5159781a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:53Z,use_quota=True,user_id='e99cc073b89b4cd589ad30cadbe596b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426f3aee-ce75-4303-833e-026270cd0307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426f3aee-ce75-4303-833e-026270cd0307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dc0be6-9780-4fa6-b406-f10b38c789ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dc0be6-9780-4fa6-b406-f10b38c789ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6af6b78-b845-4863-bcc2-78710f78ec61', 'volume_name': 'volume-b6af6b78-b845-4863-bcc2-78710f78ec61', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68da0f85-2faf-43e9-8b7a-4bef9317acc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68da0f85-2faf-43e9-8b7a-4bef9317acc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373d9f56-0d1e-4dac-abc6-3ba15b3db8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Volume b6af6b78-b845-4863-bcc2-78710f78ec61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6af6b78-b845-4863-bcc2-78710f78ec61', 'volume_size': 1} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1372033866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6af6b78-b845-4863-bcc2-78710f78ec61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0a05fb8f9410b8cc65f5159781a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:53Z,use_quota=True,user_id='e99cc073b89b4cd589ad30cadbe596b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Creating volume b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:53 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:53 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 1073741824 Sep 02 00:05:53 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:53 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 1073741824" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:53 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 Sep 02 00:05:53 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:53 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61" returned: 0 in 0.344s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373d9f56-0d1e-4dac-abc6-3ba15b3db8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6af6b78-b845-4863-bcc2-78710f78ec61', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8fb8ee-362a-4c54-960f-4fefcd872921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Volume volume-b6af6b78-b845-4863-bcc2-78710f78ec61 (b6af6b78-b845-4863-bcc2-78710f78ec61): created successfully Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8fb8ee-362a-4c54-960f-4fefcd872921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (e6dd675c-f420-4158-82df-c2ef31e9dc4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-518aa444-37ab-4c79-ba3f-b5abb1fd599b tempest-VolumesSnapshotTestJSON-414488679 None] Created volume successfully. Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Flow 'volume_create_manager' (03f5dbf0-43d0-4467-838d-c5052c62a6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab6a442-9929-4877-842a-7deff1d38fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab6a442-9929-4877-842a-7deff1d38fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1037264360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5688669-1b30-4a52-9698-d0c8bd51d9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66984865ec4ceb9589d7f105cbd16e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:54Z,use_quota=True,user_id='5ecf691bee504fbdb54cebdfbaa9e23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4cd7a7-f492-4a0a-b5f2-d70db83cc1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4cd7a7-f492-4a0a-b5f2-d70db83cc1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7c626b-cf84-495a-8fbc-3cf86d452c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7c626b-cf84-495a-8fbc-3cf86d452c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5688669-1b30-4a52-9698-d0c8bd51d9f2', 'volume_name': 'volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d60abc-4167-4a50-9db7-bc39586c5f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d60abc-4167-4a50-9db7-bc39586c5f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4257e8fe-be43-4d17-b503-cf89a8b65941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Volume b5688669-1b30-4a52-9698-d0c8bd51d9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2', 'volume_size': 1} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1037264360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5688669-1b30-4a52-9698-d0c8bd51d9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66984865ec4ceb9589d7f105cbd16e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:54Z,use_quota=True,user_id='5ecf691bee504fbdb54cebdfbaa9e23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Creating volume b5688669-1b30-4a52-9698-d0c8bd51d9f2 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:54 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 1073741824 Sep 02 00:05:54 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:54 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 1073741824" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:54 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 Sep 02 00:05:54 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:54 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4257e8fe-be43-4d17-b503-cf89a8b65941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8386cb4-a5cf-4ac1-be31-06a704212e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Volume volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 (b5688669-1b30-4a52-9698-d0c8bd51d9f2): created successfully Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8386cb4-a5cf-4ac1-be31-06a704212e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Flow 'volume_create_manager' (03f5dbf0-43d0-4467-838d-c5052c62a6f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-314371c1-8fbc-4b21-aab1-24b4989b211e tempest-VolumesListAdminTestJSON-1363955559 None] Created volume successfully. Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Creating offline snapshot 709c0b56-cde7-4c85-a818-9f42fc7d2cfe of volume b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd60c3e-588a-4ad9-aa01-6bb152428bf2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:55 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 Sep 02 00:05:55 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Flow 'volume_create_manager' (abc31b2d-64da-462c-8471-85f0a6852cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7192d255-1319-4acc-a4ad-2a0afd33d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7192d255-1319-4acc-a4ad-2a0afd33d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-863522917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33db2a1-7f2c-4913-bc08-4aac3247d1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66984865ec4ceb9589d7f105cbd16e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:56Z,use_quota=True,user_id='5ecf691bee504fbdb54cebdfbaa9e23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e966f6-9ce2-4d9e-b0a9-21b12c16d239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e966f6-9ce2-4d9e-b0a9-21b12c16d239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a814ab5-32c9-4f11-a7f5-b40af0b19ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:55 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a814ab5-32c9-4f11-a7f5-b40af0b19ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33db2a1-7f2c-4913-bc08-4aac3247d1b9', 'volume_name': 'volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db15bd0f-cc33-4c28-a289-cd2b0f55dc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db15bd0f-cc33-4c28-a289-cd2b0f55dc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8c7e24-86f0-43e8-8a48-03118ca5b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Volume f33db2a1-7f2c-4913-bc08-4aac3247d1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9', 'volume_size': 1} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61" returned: 0 in 0.460s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:55 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe 1G Sep 02 00:05:55 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:56 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe 1G" returned: 0 in 0.478s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6af6b78-b845-4863-bcc2-78710f78ec61 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:56 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6af6b78-b845-4863-bcc2-78710f78ec61 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe Sep 02 00:05:56 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:56 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6af6b78-b845-4863-bcc2-78710f78ec61 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe" returned: 0 in 0.322s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:56 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe is being set with open permissions: ugo+rw Sep 02 00:05:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:56 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe Sep 02 00:05:56 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:56 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe" returned: 0 in 0.303s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:57 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.info Sep 02 00:05:57 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:57 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.info" returned: 0 in 0.304s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:57 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.info is being set with open permissions: ugo+rw Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:57 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.info Sep 02 00:05:57 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:57 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.info" returned: 0 in 0.346s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.853s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-863522917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33db2a1-7f2c-4913-bc08-4aac3247d1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66984865ec4ceb9589d7f105cbd16e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:56Z,use_quota=True,user_id='5ecf691bee504fbdb54cebdfbaa9e23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Creating volume f33db2a1-7f2c-4913-bc08-4aac3247d1b9 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:57 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:05:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:57 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 1073741824 Sep 02 00:05:57 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dcca6e01-ee0a-415a-8fa4-7d55bc84b4fb tempest-VolumesSnapshotTestJSON-414488679 None] Create snapshot completed successfully Sep 02 00:05:58 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 1073741824" returned: 0 in 0.427s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:58 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 Sep 02 00:05:58 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:58 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9" returned: 0 in 0.304s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:05:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8c7e24-86f0-43e8-8a48-03118ca5b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22bcaa0-d63a-422a-8f30-9d5837ae3950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Volume volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 (f33db2a1-7f2c-4913-bc08-4aac3247d1b9): created successfully Sep 02 00:05:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22bcaa0-d63a-422a-8f30-9d5837ae3950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Flow 'volume_create_manager' (abc31b2d-64da-462c-8471-85f0a6852cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8eddc516-e4c5-4ec1-a599-0122df89e05b tempest-VolumesListAdminTestJSON-1363955559 None] Created volume successfully. Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (924d771c-772a-424a-98e5-ff6fc6bb9f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbb4d49-9f07-425c-8fab-8163c4389142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbb4d49-9f07-425c-8fab-8163c4389142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-894903922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d139449b-b10c-47af-8a66-01495d758ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0a05fb8f9410b8cc65f5159781a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:05:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=709c0b56-cde7-4c85-a818-9f42fc7d2cfe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:05:59Z,use_quota=True,user_id='e99cc073b89b4cd589ad30cadbe596b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc69d59d-2a05-4eb5-a849-6b430e7a806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc69d59d-2a05-4eb5-a849-6b430e7a806e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5095c477-572e-4e8c-9ef0-204bb8b173d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5095c477-572e-4e8c-9ef0-204bb8b173d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd139449b-b10c-47af-8a66-01495d758ec4', 'volume_name': 'volume-d139449b-b10c-47af-8a66-01495d758ec4', 'volume_size': 2, 'snapshot_id': '709c0b56-cde7-4c85-a818-9f42fc7d2cfe'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2632b6-d44e-4e1a-b5bf-c1e11f8258d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2632b6-d44e-4e1a-b5bf-c1e11f8258d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dddfab3-5040-40a8-b692-a5cd12b8eb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Volume d139449b-b10c-47af-8a66-01495d758ec4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d139449b-b10c-47af-8a66-01495d758ec4', 'volume_size': 2, 'snapshot_id': '709c0b56-cde7-4c85-a818-9f42fc7d2cfe'} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-709c0b56-cde7-4c85-a818-9f42fc7d2cfe-d139449b-b10c-47af-8a66-01495d758ec4" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-709c0b56-cde7-4c85-a818-9f42fc7d2cfe-d139449b-b10c-47af-8a66-01495d758ec4" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Creating volume d139449b-b10c-47af-8a66-01495d758ec4 from snapshot 709c0b56-cde7-4c85-a818-9f42fc7d2cfe {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-d139449b-b10c-47af-8a66-01495d758ec4" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-d139449b-b10c-47af-8a66-01495d758ec4" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] snapshot: 709c0b56-cde7-4c85-a818-9f42fc7d2cfe, volume: d139449b-b10c-47af-8a66-01495d758ec4, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeeedcd-4683-4899-81ce-f7180d7d6736]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:59 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe Sep 02 00:05:59 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Flow 'volume_create_manager' (8a44f6b6-3695-4a3c-9664-a70c69e337f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8652c766-637c-4441-993c-14c8e6e472a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8652c766-637c-4441-993c-14c8e6e472a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a7bd25-696b-4d65-8a13-b2bbb01b5e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fe297691f1465e924fa9f105a9a303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:00Z,use_quota=True,user_id='4a9c16f3740344408594ab261d463896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370105f0-80ea-48ea-a66c-94db1178e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370105f0-80ea-48ea-a66c-94db1178e67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5968fc5e-166f-45ba-8441-da1a132ee00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5968fc5e-166f-45ba-8441-da1a132ee00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a7bd25-696b-4d65-8a13-b2bbb01b5e68', 'volume_name': 'volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098de324-ff01-4ac4-90fb-0b7a7bede46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098de324-ff01-4ac4-90fb-0b7a7bede46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838fc84f-355c-4f79-bee1-a20f83a34fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:05:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Volume e5a7bd25-696b-4d65-8a13-b2bbb01b5e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68', 'volume_size': 1} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:05:59 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6af6b78-b845-4863-bcc2-78710f78ec61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a89b45-3cce-4860-8a8e-ebcb0c8f9f95]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:05:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:05:59 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 Sep 02 00:05:59 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:00 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:06:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:06:00 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:06:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:00 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 Sep 02 00:06:00 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:04 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4" returned: 0 in 4.042s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:06:04 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Converted 1024.00 MB image at 253.20 MB/s Sep 02 00:06:04 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 is being set with open permissions: ugo+rw Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:04 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 Sep 02 00:06:04 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:04 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4" returned: 0 in 0.233s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-d139449b-b10c-47af-8a66-01495d758ec4" released by "_copy_volume_from_snapshot" :: held 5.129s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-709c0b56-cde7-4c85-a818-9f42fc7d2cfe-d139449b-b10c-47af-8a66-01495d758ec4" released by "_create_volume_from_snapshot" :: held 5.197s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.213s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.788s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a7bd25-696b-4d65-8a13-b2bbb01b5e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fe297691f1465e924fa9f105a9a303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:00Z,use_quota=True,user_id='4a9c16f3740344408594ab261d463896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Creating volume e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:06:04 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:04 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 1073741824 Sep 02 00:06:04 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dddfab3-5040-40a8-b692-a5cd12b8eb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d139449b-b10c-47af-8a66-01495d758ec4', 'volume_size': 2, 'snapshot_id': '709c0b56-cde7-4c85-a818-9f42fc7d2cfe'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09acfe7-e355-4633-823f-8c81f80c7c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Volume volume-d139449b-b10c-47af-8a66-01495d758ec4 (d139449b-b10c-47af-8a66-01495d758ec4): created successfully Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09acfe7-e355-4633-823f-8c81f80c7c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (924d771c-772a-424a-98e5-ff6fc6bb9f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-000166ca-b9ef-49e2-8816-6adf290c2e5a tempest-VolumesSnapshotTestJSON-414488679 None] Created volume successfully. Sep 02 00:06:04 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 1073741824" returned: 0 in 0.408s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:05 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 Sep 02 00:06:05 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:05 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68" returned: 0 in 0.234s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838fc84f-355c-4f79-bee1-a20f83a34fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f428ca-e81e-4904-8257-070b29025ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Volume volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 (e5a7bd25-696b-4d65-8a13-b2bbb01b5e68): created successfully Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f428ca-e81e-4904-8257-070b29025ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Flow 'volume_create_manager' (8a44f6b6-3695-4a3c-9664-a70c69e337f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f5abcf5c-174f-44ec-ae02-e0d6fe1a2d72 tempest-VolumesListAdminTestJSON-2111438161 None] Created volume successfully. Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-d139449b-b10c-47af-8a66-01495d758ec4-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-d139449b-b10c-47af-8a66-01495d758ec4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-d139449b-b10c-47af-8a66-01495d758ec4" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-d139449b-b10c-47af-8a66-01495d758ec4" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3694922-f63c-477f-b65f-0bd6b941e04e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:05 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 Sep 02 00:06:05 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:06 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4" returned: 0 in 0.396s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:06 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4 Sep 02 00:06:06 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Acquiring lock "cinder-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "cinder-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Acquiring lock "cinder-quobyte-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "cinder-quobyte-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf54746-b05c-4ec7-8bb7-fc0220e74154]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "cinder-f33db2a1-7f2c-4913-bc08-4aac3247d1b9-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-f33db2a1-7f2c-4913-bc08-4aac3247d1b9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:06 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:06 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:06 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d139449b-b10c-47af-8a66-01495d758ec4" returned: 0 in 0.298s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:06 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 Sep 02 00:06:06 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "cinder-quobyte-f33db2a1-7f2c-4913-bc08-4aac3247d1b9" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-d139449b-b10c-47af-8a66-01495d758ec4" released by "delete_volume" :: held 0.739s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-quobyte-f33db2a1-7f2c-4913-bc08-4aac3247d1b9" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba1394-94f5-4355-886e-a2f218199918]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Created reservations ['c1ba6759-78ad-4f77-9af8-ace5c53d8311', '8917f61d-a3b4-4990-a2b4-19f45dda85dd', '44400e12-efdc-4ebb-9f61-182ae4cdfb60', '8bec5f63-a8cc-467b-8913-9c845965f5bf'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:06 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 Sep 02 00:06:06 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:06 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:06:06 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:06 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:06 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68" returned: 0 in 0.477s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:06 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68 Sep 02 00:06:06 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-709c0b56-cde7-4c85-a818-9f42fc7d2cfe-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-709c0b56-cde7-4c85-a818-9f42fc7d2cfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-b6af6b78-b845-4863-bcc2-78710f78ec61" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-b6af6b78-b845-4863-bcc2-78710f78ec61" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-709c0b56-cde7-4c85-a818-9f42fc7d2cfe" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-709c0b56-cde7-4c85-a818-9f42fc7d2cfe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Deleting offline snapshot 709c0b56-cde7-4c85-a818-9f42fc7d2cfe of volume b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] snapshot_file for this snap is: volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3dfd73-60e5-4258-a901-63647f02662c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:07 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9" returned: 0 in 0.534s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:07 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68" returned: 0 in 0.290s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:07 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9 Sep 02 00:06:07 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:07 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.380s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "cinder-quobyte-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68" released by "delete_volume" :: held 0.836s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Deleted volume successfully. Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfe75aa6-bea7-4b8d-88fc-b64fb83c38ac tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-d139449b-b10c-47af-8a66-01495d758ec4-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:07 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe Sep 02 00:06:07 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Created reservations ['2135763f-b544-4462-8625-9a11b68d36c5', '096dcb7d-b7d2-4947-8742-a6309420d7d7', '1e95e36c-e8c4-410b-957f-41f9b186008a', '1abbf949-206f-4c02-b0a2-8c4b569d8e44'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:07 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:07 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:07 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f33db2a1-7f2c-4913-bc08-4aac3247d1b9" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-quobyte-f33db2a1-7f2c-4913-bc08-4aac3247d1b9" released by "delete_volume" :: held 0.888s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Created reservations ['d59f0feb-445f-4b2a-89d6-f003770ca348', 'de3c65fd-686e-4644-a035-d8a081483015', '624b9228-1f00-4eaf-916f-0c3d100a004b', '2ba96669-07f4-4c19-80ac-ae3391fe404d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:07 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe" returned: 0 in 0.543s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6af6b78-b845-4863-bcc2-78710f78ec61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:06:07 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:07 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[55de4260-2143-4e63-8e7c-c2c392c4c0b2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:07 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Deleted volume successfully. Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6cb6ba65-1dc3-4e80-b862-879754adf234 tempest-VolumesListAdminTestJSON-2111438161 None] Lock "cinder-e5a7bd25-696b-4d65-8a13-b2bbb01b5e68-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "cinder-b5688669-1b30-4a52-9698-d0c8bd51d9f2-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-b5688669-1b30-4a52-9698-d0c8bd51d9f2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:07 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 Sep 02 00:06:07 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "cinder-quobyte-b5688669-1b30-4a52-9698-d0c8bd51d9f2" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-quobyte-b5688669-1b30-4a52-9698-d0c8bd51d9f2" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e8fcb1-e6df-4f52-bb47-c4c65ee0dbff]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:08 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.378s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Deleted volume successfully. Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-714f3e4b-8145-4dcb-bab1-0dbf421fd001 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-f33db2a1-7f2c-4913-bc08-4aac3247d1b9-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:08 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 Sep 02 00:06:08 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:08 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61" returned: 0 in 0.645s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:08 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe Sep 02 00:06:08 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:08 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2" returned: 0 in 0.475s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:08 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2 Sep 02 00:06:08 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:08 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b5688669-1b30-4a52-9698-d0c8bd51d9f2" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-quobyte-b5688669-1b30-4a52-9698-d0c8bd51d9f2" released by "delete_volume" :: held 0.815s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:08 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe" returned: 0 in 0.380s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:08 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe Sep 02 00:06:08 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Created reservations ['482301cd-71d7-450d-b8e8-2b2a07ceda41', '320541bf-a43a-471b-b047-bad31c4ae834', '6b0d2f0b-c00a-4bfe-be8f-21539eacc20c', '56ce45d9-f7cd-496b-a48d-4faacc8ad10e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:08 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:08 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:09 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61.709c0b56-cde7-4c85-a818-9f42fc7d2cfe" returned: 0 in 0.269s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-709c0b56-cde7-4c85-a818-9f42fc7d2cfe" released by "_delete_snapshot" :: held 1.991s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-b6af6b78-b845-4863-bcc2-78710f78ec61" released by "delete_snapshot" :: held 2.022s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "cinder-04a085ef-94df-4405-b911-27b4b7982397-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-04a085ef-94df-4405-b911-27b4b7982397-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Created reservations ['72149bb0-39ce-482e-9dc2-4d5cd91354d5', '1475cc00-2ba1-4ebe-98be-7ded6ee975eb', '0aa61cf4-f4d0-42ec-b0f0-bd178919adce', '5c6f3091-9436-463a-81c7-92b701c9e30a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:09 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Deleted volume successfully. Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "cinder-quobyte-04a085ef-94df-4405-b911-27b4b7982397" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7957cb7e-0a1e-4d2c-8871-a00637787dc9 tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-b5688669-1b30-4a52-9698-d0c8bd51d9f2-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-quobyte-04a085ef-94df-4405-b911-27b4b7982397" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Delete snapshot completed successfully. Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b2c3c0-9de1-4f35-8a75-a44e77967073]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3d8aa92e-127f-43ee-8037-c546f43a0a03 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-709c0b56-cde7-4c85-a818-9f42fc7d2cfe-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:09 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397 Sep 02 00:06:09 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:09 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397" returned: 0 in 0.341s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:09 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397 Sep 02 00:06:09 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:09 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04a085ef-94df-4405-b911-27b4b7982397" returned: 0 in 0.260s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-quobyte-04a085ef-94df-4405-b911-27b4b7982397" released by "delete_volume" :: held 0.640s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:09 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Created reservations ['9fea6dab-96ac-4430-a973-609222c065fa', '617e2bd6-1100-4d84-b8cf-2d154775fe32', 'e24fca61-85b8-4240-b420-a5a5e885c0b8', 'ec582aed-b99c-4450-9e49-c5da89683a9e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:10 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:10 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:10 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.259s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Deleted volume successfully. Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-b6af6b78-b845-4863-bcc2-78710f78ec61-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5c05ad3-126d-4cdc-b371-5267cbc67bbe tempest-VolumesListAdminTestJSON-1363955559 None] Lock "cinder-04a085ef-94df-4405-b911-27b4b7982397-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-b6af6b78-b845-4863-bcc2-78710f78ec61-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-b6af6b78-b845-4863-bcc2-78710f78ec61" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-b6af6b78-b845-4863-bcc2-78710f78ec61" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd6f11f-d2da-4dc7-a98a-0560e8cfcdaf]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:10 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 Sep 02 00:06:10 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:10 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61" returned: 0 in 0.360s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:10 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61 Sep 02 00:06:10 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:11 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6af6b78-b845-4863-bcc2-78710f78ec61" returned: 0 in 0.245s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-b6af6b78-b845-4863-bcc2-78710f78ec61" released by "delete_volume" :: held 0.673s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Created reservations ['dfeeedd4-ca67-4944-9da2-3d9f7db3b0fe', 'e6abaab8-e654-496e-92e3-40bc46c0971e', '06f83647-7d47-4c51-b4ad-d4ed12a718e0', '4d3d5677-4b5e-4c91-84db-566e148664c0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:11 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:11 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:11 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.279s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Deleted volume successfully. Sep 02 00:06:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82f044-9bdb-4f07-a22b-d4825a543358 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-b6af6b78-b845-4863-bcc2-78710f78ec61-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (04703008-ad14-4c91-957b-c905f1f42817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5504f5-7fa5-472b-89e6-e02ef7d1c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5504f5-7fa5-472b-89e6-e02ef7d1c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-911896524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dacc43-aee6-4700-bc27-2070441ec393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0a05fb8f9410b8cc65f5159781a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:12Z,use_quota=True,user_id='e99cc073b89b4cd589ad30cadbe596b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5e7bb0-30bd-40bf-b37f-7fdb010febb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5e7bb0-30bd-40bf-b37f-7fdb010febb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e40481-29c7-475a-983f-369d9470c13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e40481-29c7-475a-983f-369d9470c13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23dacc43-aee6-4700-bc27-2070441ec393', 'volume_name': 'volume-23dacc43-aee6-4700-bc27-2070441ec393', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590fb0e0-d9dc-4fa7-a1f2-5e80ffdc3251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590fb0e0-d9dc-4fa7-a1f2-5e80ffdc3251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a703b26-b6a0-488e-87d4-a0124aba7000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Volume 23dacc43-aee6-4700-bc27-2070441ec393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23dacc43-aee6-4700-bc27-2070441ec393', 'volume_size': 1} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-911896524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dacc43-aee6-4700-bc27-2070441ec393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0a05fb8f9410b8cc65f5159781a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:12Z,use_quota=True,user_id='e99cc073b89b4cd589ad30cadbe596b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Creating volume 23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:06:12 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:12 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 1073741824 Sep 02 00:06:12 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:12 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 1073741824" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:12 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 Sep 02 00:06:12 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:12 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393" returned: 0 in 0.271s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a703b26-b6a0-488e-87d4-a0124aba7000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23dacc43-aee6-4700-bc27-2070441ec393', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b73d59-2e52-4c8b-9c66-50db207f68e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Volume volume-23dacc43-aee6-4700-bc27-2070441ec393 (23dacc43-aee6-4700-bc27-2070441ec393): created successfully Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b73d59-2e52-4c8b-9c66-50db207f68e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (04703008-ad14-4c91-957b-c905f1f42817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ebc0d97d-b4b0-4348-bc1d-4d06950ce9f8 tempest-VolumesSnapshotTestJSON-414488679 None] Created volume successfully. Sep 02 00:06:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Creating offline snapshot 1c783781-612c-4cd7-a30c-2662e1ecc144 of volume 23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:06:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639c5bf-ceb5-42c2-9174-bef46e139491]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:13 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 Sep 02 00:06:13 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:13 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393" returned: 0 in 0.366s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:13 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 1G Sep 02 00:06:13 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:14 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 1G" returned: 0 in 0.396s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23dacc43-aee6-4700-bc27-2070441ec393 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:14 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23dacc43-aee6-4700-bc27-2070441ec393 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 Sep 02 00:06:14 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:14 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23dacc43-aee6-4700-bc27-2070441ec393 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:14 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 is being set with open permissions: ugo+rw Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:14 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 Sep 02 00:06:14 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Flow 'volume_create_manager' (daa864c9-28e9-4b25-8aa0-4d85c7aa4301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14cd65c-b1c0-4f3d-83ae-e6150039a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14cd65c-b1c0-4f3d-83ae-e6150039a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1938788380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907d4cbf-b7bb-437e-a959-95d8f7f7c6d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be2829fee2c4a63b58004df218f5f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:14Z,use_quota=True,user_id='bb3c1e44348d410e8cea2788121dc642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c258324d-e33f-4a7d-93e6-c66af26fe5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c258324d-e33f-4a7d-93e6-c66af26fe5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151b4b8b-0f99-4c0f-982b-3300ff5691c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151b4b8b-0f99-4c0f-982b-3300ff5691c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907d4cbf-b7bb-437e-a959-95d8f7f7c6d7', 'volume_name': 'volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5765fbe3-cdaf-4608-8286-cacca48c1f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5765fbe3-cdaf-4608-8286-cacca48c1f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83f841d-3a2a-4072-b899-6cda43561b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:14 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Volume 907d4cbf-b7bb-437e-a959-95d8f7f7c6d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7', 'volume_size': 1} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:14 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144" returned: 0 in 0.233s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:14 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.info Sep 02 00:06:14 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:14 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.info" returned: 0 in 0.242s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:14 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.info is being set with open permissions: ugo+rw Sep 02 00:06:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:14 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.info Sep 02 00:06:14 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:15 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.info" returned: 0 in 0.229s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1938788380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907d4cbf-b7bb-437e-a959-95d8f7f7c6d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be2829fee2c4a63b58004df218f5f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:14Z,use_quota=True,user_id='bb3c1e44348d410e8cea2788121dc642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Creating volume 907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:06:15 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:15 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 1073741824 Sep 02 00:06:15 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-37eeb083-1bf1-4929-8321-a330d0fad957 tempest-VolumesSnapshotTestJSON-414488679 None] Create snapshot completed successfully Sep 02 00:06:15 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 1073741824" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:15 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 Sep 02 00:06:15 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:15 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7" returned: 0 in 0.258s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83f841d-3a2a-4072-b899-6cda43561b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3597c9fc-dcd2-450b-b9b2-ffb1b3b311ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:15 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Volume volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 (907d4cbf-b7bb-437e-a959-95d8f7f7c6d7): created successfully Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3597c9fc-dcd2-450b-b9b2-ffb1b3b311ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Flow 'volume_create_manager' (daa864c9-28e9-4b25-8aa0-4d85c7aa4301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:06:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6575fbb0-f814-493b-812e-0bba1c8b9a1e tempest-VolumesMetadataTest-424415438 None] Created volume successfully. Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (2e50aa63-2c25-4f94-b48a-970d7688f4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0deadd-a604-40d6-ba8d-6a74652ac34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0deadd-a604-40d6-ba8d-6a74652ac34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1763986317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20dddd75-37ba-4eb9-aeb1-3b5097221946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0a05fb8f9410b8cc65f5159781a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c783781-612c-4cd7-a30c-2662e1ecc144,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:16Z,use_quota=True,user_id='e99cc073b89b4cd589ad30cadbe596b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27ffbf1-a9e3-41ec-b1da-daaf8b305f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27ffbf1-a9e3-41ec-b1da-daaf8b305f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b4f0ec-57e9-48a8-bed7-9afed4eff4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b4f0ec-57e9-48a8-bed7-9afed4eff4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20dddd75-37ba-4eb9-aeb1-3b5097221946', 'volume_name': 'volume-20dddd75-37ba-4eb9-aeb1-3b5097221946', 'volume_size': 1, 'snapshot_id': '1c783781-612c-4cd7-a30c-2662e1ecc144'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807bdf39-2b6b-47b9-9957-0c52f444b755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807bdf39-2b6b-47b9-9957-0c52f444b755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45836dd-e39e-491f-9191-3fafe0813238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Volume 20dddd75-37ba-4eb9-aeb1-3b5097221946: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20dddd75-37ba-4eb9-aeb1-3b5097221946', 'volume_size': 1, 'snapshot_id': '1c783781-612c-4cd7-a30c-2662e1ecc144'} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-1c783781-612c-4cd7-a30c-2662e1ecc144-20dddd75-37ba-4eb9-aeb1-3b5097221946" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-1c783781-612c-4cd7-a30c-2662e1ecc144-20dddd75-37ba-4eb9-aeb1-3b5097221946" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Creating volume 20dddd75-37ba-4eb9-aeb1-3b5097221946 from snapshot 1c783781-612c-4cd7-a30c-2662e1ecc144 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-20dddd75-37ba-4eb9-aeb1-3b5097221946" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-20dddd75-37ba-4eb9-aeb1-3b5097221946" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] snapshot: 1c783781-612c-4cd7-a30c-2662e1ecc144, volume: 20dddd75-37ba-4eb9-aeb1-3b5097221946, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[30693d87-4e1a-467d-9e63-8d720c33b585]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:16 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 Sep 02 00:06:16 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:16 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23dacc43-aee6-4700-bc27-2070441ec393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3303d98-87be-4cec-97c0-ff0b4ec03ce0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:16 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 Sep 02 00:06:16 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:16 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393" returned: 0 in 0.381s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:06:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:16 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 Sep 02 00:06:16 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Acquiring lock "cinder-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Lock "cinder-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Acquiring lock "cinder-quobyte-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Lock "cinder-quobyte-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7ad6d7-dc45-4e0b-abca-f75970242c4a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:17 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 Sep 02 00:06:17 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:17 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7" returned: 0 in 0.641s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:17 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7 Sep 02 00:06:17 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:18 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7" returned: 0 in 0.492s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Lock "cinder-quobyte-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7" released by "delete_volume" :: held 1.216s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Created reservations ['bec9f4dc-de61-4670-a14a-954922913464', '1cabbe15-1a0b-4182-b5db-9c28341a7d66', '60b954af-b8ee-41ad-b1aa-54dc47d5e54c', 'f45f69e3-d98d-44b5-92d8-8d1abebfc0bf'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:18 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:18 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:19 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.488s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Deleted volume successfully. Sep 02 00:06:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8865026c-aeee-45ad-b83e-36717d964813 tempest-VolumesMetadataTest-424415438 None] Lock "cinder-907d4cbf-b7bb-437e-a959-95d8f7f7c6d7-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:21 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946" returned: 0 in 4.761s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:06:21 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Converted 1024.00 MB image at 215.03 MB/s Sep 02 00:06:21 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 is being set with open permissions: ugo+rw Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:21 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 Sep 02 00:06:21 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:21 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-20dddd75-37ba-4eb9-aeb1-3b5097221946" released by "_copy_volume_from_snapshot" :: held 5.823s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-1c783781-612c-4cd7-a30c-2662e1ecc144-20dddd75-37ba-4eb9-aeb1-3b5097221946" released by "_create_volume_from_snapshot" :: held 5.893s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.907s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45836dd-e39e-491f-9191-3fafe0813238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20dddd75-37ba-4eb9-aeb1-3b5097221946', 'volume_size': 1, 'snapshot_id': '1c783781-612c-4cd7-a30c-2662e1ecc144'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac841d6a-be2f-4cd2-96f4-16874d014760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Volume volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 (20dddd75-37ba-4eb9-aeb1-3b5097221946): created successfully Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac841d6a-be2f-4cd2-96f4-16874d014760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Flow 'volume_create_manager' (2e50aa63-2c25-4f94-b48a-970d7688f4f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-35b37897-f47c-438e-8bc7-8ec3ddf38a6f tempest-VolumesSnapshotTestJSON-414488679 None] Created volume successfully. Sep 02 00:06:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-20dddd75-37ba-4eb9-aeb1-3b5097221946-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-20dddd75-37ba-4eb9-aeb1-3b5097221946-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-20dddd75-37ba-4eb9-aeb1-3b5097221946" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-20dddd75-37ba-4eb9-aeb1-3b5097221946" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2284ba21-44eb-43c8-b1e0-37751614ea72]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:22 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 Sep 02 00:06:22 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:23 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946" returned: 0 in 0.359s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:23 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946 Sep 02 00:06:23 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:23 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-20dddd75-37ba-4eb9-aeb1-3b5097221946" returned: 0 in 0.278s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-20dddd75-37ba-4eb9-aeb1-3b5097221946" released by "delete_volume" :: held 0.688s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Created reservations ['41b53187-9191-43a4-84b0-c2661bfe458c', '0ab89bec-903e-400b-917f-e97f726d83f9', 'b9c9c801-a96a-42c1-9d21-d272e3e00ebb', 'e9e21bf0-f1f2-471d-bd3b-fbff100dc4e3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:23 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:23 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:23 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.325s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Deleted volume successfully. Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-1c783781-612c-4cd7-a30c-2662e1ecc144-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-1c783781-612c-4cd7-a30c-2662e1ecc144-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-23dacc43-aee6-4700-bc27-2070441ec393" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00a26262-7697-4d29-a5c7-0e1bd75cfbcc tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-20dddd75-37ba-4eb9-aeb1-3b5097221946-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-23dacc43-aee6-4700-bc27-2070441ec393" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-1c783781-612c-4cd7-a30c-2662e1ecc144" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-1c783781-612c-4cd7-a30c-2662e1ecc144" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Deleting offline snapshot 1c783781-612c-4cd7-a30c-2662e1ecc144 of volume 23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] snapshot_file for this snap is: volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f199fd-ffce-43ff-b01a-aa9e3ab6e3cc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:24 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 Sep 02 00:06:24 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:24 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144" returned: 0 in 0.452s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23dacc43-aee6-4700-bc27-2070441ec393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:06:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf19e9d-9e1c-49dd-8f95-4ae7f97a32c4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:24 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 Sep 02 00:06:24 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:25 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393" returned: 0 in 0.715s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:25 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 Sep 02 00:06:25 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:06:25 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Flow 'volume_create_manager' (2c8bd5fc-3456-4f00-bb9c-47e0b97c42e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f976df0-b595-4ec2-b358-b120fcfcce8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144" returned: 0 in 0.574s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f976df0-b595-4ec2-b358-b120fcfcce8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-215174249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d92054-e9bd-434d-ac9e-10176de608c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8c491138f9482ca7f55605227b1d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:26Z,use_quota=True,user_id='8d69ab362b4d45269e924bdb20d8e346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79942fb6-ec5c-42f1-9b80-6f732b114856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:25 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144 Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79942fb6-ec5c-42f1-9b80-6f732b114856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:25 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a353a2-4dbe-4426-a994-fa2225e864f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a353a2-4dbe-4426-a994-fa2225e864f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d92054-e9bd-434d-ac9e-10176de608c9', 'volume_name': 'volume-a1d92054-e9bd-434d-ac9e-10176de608c9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecffe597-d900-494e-85c4-e9c348217072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecffe597-d900-494e-85c4-e9c348217072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65f778b-bd2c-4b06-b65f-ff0e48deb57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:25 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Volume a1d92054-e9bd-434d-ac9e-10176de608c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d92054-e9bd-434d-ac9e-10176de608c9', 'volume_size': 1} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-215174249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d92054-e9bd-434d-ac9e-10176de608c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8c491138f9482ca7f55605227b1d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:26Z,use_quota=True,user_id='8d69ab362b4d45269e924bdb20d8e346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Creating volume a1d92054-e9bd-434d-ac9e-10176de608c9 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:06:25 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:06:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:25 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9 1073741824 Sep 02 00:06:25 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:26 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393.1c783781-612c-4cd7-a30c-2662e1ecc144" returned: 0 in 0.444s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-1c783781-612c-4cd7-a30c-2662e1ecc144" released by "_delete_snapshot" :: held 2.340s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-23dacc43-aee6-4700-bc27-2070441ec393" released by "delete_snapshot" :: held 2.369s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Created reservations ['a244ba99-ba5f-425e-a956-9581ce2215a9', 'd9bed2e6-4bf5-4980-90a4-2fb24f6b4a6e', '35000c36-92ed-4bcb-a91a-af53c823c5c4', '0dd79e85-ed0d-492a-bab7-fb1963493389'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Delete snapshot completed successfully. Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c345366d-1adf-4b43-a741-c8c1db388c4c tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-1c783781-612c-4cd7-a30c-2662e1ecc144-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:26 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-3b016cdc-2dbc-4674-8626-c92a69580d4a req-61eab1ce-f574-46b4-acb3-771318333260 tempest-TestMinimumBasicScenario-1150868788 None] Terminate volume connection completed successfully. Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-3b016cdc-2dbc-4674-8626-c92a69580d4a req-61eab1ce-f574-46b4-acb3-771318333260 tempest-TestMinimumBasicScenario-1150868788 None] Deleting attachment df633eb5-a83c-4de0-ad8f-a953cf5b148b. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9 1073741824" returned: 0 in 0.612s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:26 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9 Sep 02 00:06:26 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:26 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9" returned: 0 in 0.258s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65f778b-bd2c-4b06-b65f-ff0e48deb57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d92054-e9bd-434d-ac9e-10176de608c9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2449e9c5-57ce-4720-89ce-59aef29e8486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Volume volume-a1d92054-e9bd-434d-ac9e-10176de608c9 (a1d92054-e9bd-434d-ac9e-10176de608c9): created successfully Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2449e9c5-57ce-4720-89ce-59aef29e8486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Flow 'volume_create_manager' (2c8bd5fc-3456-4f00-bb9c-47e0b97c42e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0ee66fff-0598-484f-8e22-1359617419e4 tempest-VolumesTransfersV357Test-621206855 None] Created volume successfully. Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-23dacc43-aee6-4700-bc27-2070441ec393-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-23dacc43-aee6-4700-bc27-2070441ec393-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-23dacc43-aee6-4700-bc27-2070441ec393" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-23dacc43-aee6-4700-bc27-2070441ec393" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2a5e4c-ffdd-4418-bfab-e0d205fbcca8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Acquiring lock "cinder-7455698c-003c-4379-b778-2b89b9f9e807-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Lock "cinder-7455698c-003c-4379-b778-2b89b9f9e807-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:27 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 Sep 02 00:06:27 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Acquiring lock "cinder-quobyte-7455698c-003c-4379-b778-2b89b9f9e807" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Lock "cinder-quobyte-7455698c-003c-4379-b778-2b89b9f9e807" acquired by "delete_volume" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a03113-780c-47d1-b268-d0ac335e5e78]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:27 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807 Sep 02 00:06:27 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:27 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:27 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393 Sep 02 00:06:27 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:27 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:27 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807 Sep 02 00:06:27 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:27 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-23dacc43-aee6-4700-bc27-2070441ec393" returned: 0 in 0.298s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-23dacc43-aee6-4700-bc27-2070441ec393" released by "delete_volume" :: held 0.737s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Created reservations ['bb05a864-851b-4565-9cee-f28bbdf096d7', '78b3b3e3-1e35-4ed5-8f99-714beb64c551', '7da9a3d9-f597-44a5-b078-480059f6c6f4', 'e18c0b27-372d-461f-b1c4-40d886c81687'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:28 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7455698c-003c-4379-b778-2b89b9f9e807" returned: 0 in 0.266s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Lock "cinder-quobyte-7455698c-003c-4379-b778-2b89b9f9e807" released by "delete_volume" :: held 0.699s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:28 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:28 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Created reservations ['4f8186de-94bd-4ecf-b768-3be8109d875c', 'a68d5841-e542-4d1f-bbc6-e93ad9f5f39b', 'bd321b97-a52d-4515-a2fb-d067f1487e66', '24895dde-cdc8-4595-86d5-154e64b5a963'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:28 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:28 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:28 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-df4314d7-1daa-494d-b6d8-fb09b43d76ea-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Deleted volume successfully. Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-df4314d7-1daa-494d-b6d8-fb09b43d76ea-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5762685c-e71b-4f48-9550-8614147b40d5 tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-23dacc43-aee6-4700-bc27-2070441ec393-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "cinder-quobyte-df4314d7-1daa-494d-b6d8-fb09b43d76ea" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-df4314d7-1daa-494d-b6d8-fb09b43d76ea" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:28 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.356s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a83819-41f0-4cd9-91ed-497566890795]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Deleted volume successfully. Sep 02 00:06:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8f2370cc-4ccc-4136-8f3b-07548ce64f78 tempest-VolumesTransfersV357Test-1536071139 None] Transfer volume completed successfully. Sep 02 00:06:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aba7888b-009c-468e-beed-a69f924cf483 tempest-TestMinimumBasicScenario-1150868788 None] Lock "cinder-7455698c-003c-4379-b778-2b89b9f9e807-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:28 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea Sep 02 00:06:28 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:29 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea" returned: 0 in 0.681s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:29 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea Sep 02 00:06:29 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Acquiring lock "cinder-a1d92054-e9bd-434d-ac9e-10176de608c9-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Lock "cinder-a1d92054-e9bd-434d-ac9e-10176de608c9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Acquiring lock "cinder-quobyte-a1d92054-e9bd-434d-ac9e-10176de608c9" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Lock "cinder-quobyte-a1d92054-e9bd-434d-ac9e-10176de608c9" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab370644-94c4-4990-a710-042e22b4bdf4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:29 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-df4314d7-1daa-494d-b6d8-fb09b43d76ea" returned: 0 in 0.341s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-quobyte-df4314d7-1daa-494d-b6d8-fb09b43d76ea" released by "delete_volume" :: held 1.109s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:29 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9 Sep 02 00:06:29 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Created reservations ['b9d03768-65db-47f9-bd83-f6d918c8f584', '439ecf4a-590a-43be-86fa-90424fa1598a', '628d91d6-5b7e-4862-8617-442dd3597a15', '38eb5a73-205e-46be-ae7d-add0e3e08488'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:29 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:29 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:29 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:30 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9 Sep 02 00:06:30 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:30 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.279s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Deleted volume successfully. Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-db262de6-2c1a-4397-8b1c-aed7a63645dd tempest-VolumesSnapshotTestJSON-414488679 None] Lock "cinder-df4314d7-1daa-494d-b6d8-fb09b43d76ea-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:30 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a1d92054-e9bd-434d-ac9e-10176de608c9" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Lock "cinder-quobyte-a1d92054-e9bd-434d-ac9e-10176de608c9" released by "delete_volume" :: held 0.762s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Created reservations ['41c832a9-fcf7-45f1-a01a-2b70d6b83655', '06c60ffa-82ef-4159-ba2f-f29a64821071', '26f9b94f-7a24-4781-a314-9797207ca253', '9d337287-2e3b-487d-919e-1c6da1b17921'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:30 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:30 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:30 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Deleted volume successfully. Sep 02 00:06:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd72f58a-c093-41fb-926e-9b9eee5d6be7 tempest-VolumesTransfersV357Test-2063483936 None] Lock "cinder-a1d92054-e9bd-434d-ac9e-10176de608c9-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Flow 'volume_create_manager' (8f1bcd76-0adc-41bc-92ae-d264dc4a2046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e5f93a-8ca0-447a-89e5-864bbc5def2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e5f93a-8ca0-447a-89e5-864bbc5def2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1479668160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fc7559-9de8-40f8-943c-0c90aa51c16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8c491138f9482ca7f55605227b1d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:31Z,use_quota=True,user_id='8d69ab362b4d45269e924bdb20d8e346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97097a84-3c42-4cd6-b073-f5f93d22306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97097a84-3c42-4cd6-b073-f5f93d22306b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3eb22ed-8c51-45c3-824d-dc1f731beb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3eb22ed-8c51-45c3-824d-dc1f731beb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7fc7559-9de8-40f8-943c-0c90aa51c16d', 'volume_name': 'volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a9c1dc-4915-4894-a85b-79f6e93c7b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a9c1dc-4915-4894-a85b-79f6e93c7b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4323ac1-b400-477c-ab03-97668f5a4f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:31 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Volume a7fc7559-9de8-40f8-943c-0c90aa51c16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d', 'volume_size': 1} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1479668160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fc7559-9de8-40f8-943c-0c90aa51c16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8c491138f9482ca7f55605227b1d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:31Z,use_quota=True,user_id='8d69ab362b4d45269e924bdb20d8e346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Creating volume a7fc7559-9de8-40f8-943c-0c90aa51c16d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:06:31 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:31 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d 1073741824 Sep 02 00:06:31 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:31 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d 1073741824" returned: 0 in 0.555s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:31 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d Sep 02 00:06:31 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:32 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:06:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4323ac1-b400-477c-ab03-97668f5a4f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fce46d-f79d-4cf8-9f70-3e6c4a038299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:32 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Volume volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d (a7fc7559-9de8-40f8-943c-0c90aa51c16d): created successfully Sep 02 00:06:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fce46d-f79d-4cf8-9f70-3e6c4a038299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Flow 'volume_create_manager' (8f1bcd76-0adc-41bc-92ae-d264dc4a2046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7f0cba89-a525-49b0-9b9e-97aed6061c5f tempest-VolumesTransfersV357Test-621206855 None] Created volume successfully. Sep 02 00:06:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Acquiring lock "cinder-a7fc7559-9de8-40f8-943c-0c90aa51c16d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Lock "cinder-a7fc7559-9de8-40f8-943c-0c90aa51c16d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Acquiring lock "cinder-quobyte-a7fc7559-9de8-40f8-943c-0c90aa51c16d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Lock "cinder-quobyte-a7fc7559-9de8-40f8-943c-0c90aa51c16d" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:33 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb1ba2d-f7b6-4f12-b4f0-da1804b6c87c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:33 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d Sep 02 00:06:33 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:34 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d" returned: 0 in 0.353s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:34 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d Sep 02 00:06:34 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:34 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a7fc7559-9de8-40f8-943c-0c90aa51c16d" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Lock "cinder-quobyte-a7fc7559-9de8-40f8-943c-0c90aa51c16d" released by "delete_volume" :: held 0.687s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Created reservations ['453d3aa6-10e1-4045-875f-55083051f0d0', '6f1a0432-156b-4c71-a29f-cf76333798ef', 'd854d9a8-5f55-4b72-8e3b-85c5eb37e1b9', '5a4041eb-e2c2-4666-980e-8ad910437fec'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:34 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:34 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:34 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.327s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Deleted volume successfully. Sep 02 00:06:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4f05b643-97a2-421c-98ba-97bcdb015184 tempest-VolumesTransfersV357Test-2063483936 None] Lock "cinder-a7fc7559-9de8-40f8-943c-0c90aa51c16d-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:43 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:06:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Flow 'volume_create_manager' (dd1f46fa-d999-4ee4-95b8-170d2df5b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1ef74e-fd82-42c5-81da-a00f5571f6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1ef74e-fd82-42c5-81da-a00f5571f6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2020622023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e38dbe5-c014-40c2-baf1-c8261838e7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349ffbe7ab9c4430b0c2bdaa0e1bd16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:44Z,use_quota=True,user_id='7c875b8d8c7b4f7081e6e42ceef3c644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599fc393-91f4-4959-985b-febc2cc5ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599fc393-91f4-4959-985b-febc2cc5ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c972f21a-d34b-4fa9-bfdf-7ed1586478ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:43 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:06:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c972f21a-d34b-4fa9-bfdf-7ed1586478ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e38dbe5-c014-40c2-baf1-c8261838e7be', 'volume_name': 'volume-8e38dbe5-c014-40c2-baf1-c8261838e7be', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1853ecd6-b370-470b-b0ed-3cf36beb3ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1853ecd6-b370-470b-b0ed-3cf36beb3ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a15cf97-6903-4d91-8876-702bbd45b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:44 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Volume 8e38dbe5-c014-40c2-baf1-c8261838e7be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e38dbe5-c014-40c2-baf1-c8261838e7be', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 00:06:44 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Trying to clone 8e38dbe5-c014-40c2-baf1-c8261838e7be from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:06:44 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:06:44 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Image download 20.69 MB at 20.69 MB/s Sep 02 00:06:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e5775d-79fc-4c83-96e8-8ec6db2f9526]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:45 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD Sep 02 00:06:45 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:45 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 is fetched for user 7c875b8d8c7b4f7081e6e42ceef3c644. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5a4e00-6d5c-4100-954e-57884bd91225]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:45 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD Sep 02 00:06:45 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:45 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2020622023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e38dbe5-c014-40c2-baf1-c8261838e7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349ffbe7ab9c4430b0c2bdaa0e1bd16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:44Z,use_quota=True,user_id='7c875b8d8c7b4f7081e6e42ceef3c644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Creating volume 8e38dbe5-c014-40c2-baf1-c8261838e7be {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:06:45 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:06:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:45 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be 1073741824 Sep 02 00:06:45 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:46 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be 1073741824" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:46 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be Sep 02 00:06:46 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:46 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be" returned: 0 in 0.313s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:06:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:46 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Attempting download of 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume 8e38dbe5-c014-40c2-baf1-c8261838e7be. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:06:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf716c2-f916-47be-9b0d-ce68d0e7bad8]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_epnzp1i9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:47 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_epnzp1i9 Sep 02 00:06:47 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:47 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_epnzp1i9" returned: 0 in 0.422s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_epnzp1i9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:47 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_epnzp1i9 Sep 02 00:06:47 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:47 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_epnzp1i9" returned: 1 in 0.347s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_epnzp1i9' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:06:47 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9ce2f8-df14-4905-9dd9-6335cef7ce30]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:47 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD Sep 02 00:06:47 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:48 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:48 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] 7ac8008a-9a50-4a29-8129-58d061cbfda5 was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:06:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:48 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be Sep 02 00:06:48 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:50 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be" returned: 0 in 2.199s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_326i3xs8devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:06:50 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Converted 112.00 MB image at 50.90 MB/s Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:50 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be 1G Sep 02 00:06:50 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:50 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be 1G" returned: 0 in 0.419s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Downloaded image 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume 8e38dbe5-c014-40c2-baf1-c8261838e7be successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 for user 7c875b8d8c7b4f7081e6e42ceef3c644 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Marking volume 8e38dbe5-c014-40c2-baf1-c8261838e7be as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Copying metadata from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 to 8e38dbe5-c014-40c2-baf1-c8261838e7be. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Creating volume glance metadata for volume 8e38dbe5-c014-40c2-baf1-c8261838e7be backed by image 7ac8008a-9a50-4a29-8129-58d061cbfda5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=106,cinder:UPDATE=159,cinder:INSERT=40,cinder:DELETE=12 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a15cf97-6903-4d91-8876-702bbd45b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e38dbe5-c014-40c2-baf1-c8261838e7be', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb950b53-6007-49ad-baec-edacb87e0917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Volume volume-8e38dbe5-c014-40c2-baf1-c8261838e7be (8e38dbe5-c014-40c2-baf1-c8261838e7be): created successfully Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb950b53-6007-49ad-baec-edacb87e0917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Flow 'volume_create_manager' (dd1f46fa-d999-4ee4-95b8-170d2df5b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7c0e634a-5beb-4a01-a8c2-907dc1f22e14 tempest-VolumesExtendTest-1371660697 None] Created volume successfully. Sep 02 00:06:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-15decea4-acfb-4919-b76d-7ab7a95f649f tempest-VolumesExtendTest-1371660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-15decea4-acfb-4919-b76d-7ab7a95f649f tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc0282d-03cb-449c-8c20-1a503139f8ad]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15decea4-acfb-4919-b76d-7ab7a95f649f tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:51 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be Sep 02 00:06:51 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:52 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15decea4-acfb-4919-b76d-7ab7a95f649f tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be" returned: 0 in 0.511s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15decea4-acfb-4919-b76d-7ab7a95f649f tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be 2G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15decea4-acfb-4919-b76d-7ab7a95f649f tempest-VolumesExtendTest-1371660697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be 2G" returned: 0 in 0.125s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-15decea4-acfb-4919-b76d-7ab7a95f649f tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.673s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:52 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=140,cinder:UPDATE=162,cinder:INSERT=48,cinder:DELETE=15 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:06:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-15decea4-acfb-4919-b76d-7ab7a95f649f tempest-VolumesExtendTest-1371660697 None] Extend volume completed successfully. Sep 02 00:06:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Acquiring lock "cinder-8e38dbe5-c014-40c2-baf1-c8261838e7be-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Lock "cinder-8e38dbe5-c014-40c2-baf1-c8261838e7be-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Acquiring lock "cinder-quobyte-8e38dbe5-c014-40c2-baf1-c8261838e7be" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Lock "cinder-quobyte-8e38dbe5-c014-40c2-baf1-c8261838e7be" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d28592-b22d-426d-8b93-9a8d16ae1092]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:53 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be Sep 02 00:06:53 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:53 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be" returned: 0 in 0.436s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:53 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be Sep 02 00:06:53 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:53 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8e38dbe5-c014-40c2-baf1-c8261838e7be" returned: 0 in 0.273s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Lock "cinder-quobyte-8e38dbe5-c014-40c2-baf1-c8261838e7be" released by "delete_volume" :: held 0.758s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Created reservations ['7f746567-18d4-42e2-9286-78706d2ad271', '91346290-789e-4e83-a6a0-4c1c4df1b03c', '92ef1841-6cc5-4516-b2dc-aa1771df24f5', '9d7ff53a-e176-43b8-84b1-642655a0abec'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:54 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:06:54 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:54 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:06:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Deleted volume successfully. Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a076b8f4-1ee5-4a8b-ba58-a5a96726c9bc tempest-VolumesExtendTest-1371660697 None] Lock "cinder-8e38dbe5-c014-40c2-baf1-c8261838e7be-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Flow 'volume_create_manager' (74563375-4321-4fe6-8929-48474e239935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e344c9-6073-4277-a47b-1eaef7c6a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e344c9-6073-4277-a47b-1eaef7c6a277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1720236358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87ed3a0-b894-4ad1-a772-b7f6a95c75ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349ffbe7ab9c4430b0c2bdaa0e1bd16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:55Z,use_quota=True,user_id='7c875b8d8c7b4f7081e6e42ceef3c644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1457982-529a-49be-af5f-2f2afd5e07c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1457982-529a-49be-af5f-2f2afd5e07c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f080e6d5-7c0a-4db5-becd-3b384804f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f080e6d5-7c0a-4db5-becd-3b384804f333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c87ed3a0-b894-4ad1-a772-b7f6a95c75ca', 'volume_name': 'volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c073f49-eab7-4f96-9907-36908c941c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c073f49-eab7-4f96-9907-36908c941c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245952e0-6464-44dc-b149-8a336f0bd766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Volume c87ed3a0-b894-4ad1-a772-b7f6a95c75ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca', 'volume_size': 1} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1720236358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87ed3a0-b894-4ad1-a772-b7f6a95c75ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349ffbe7ab9c4430b0c2bdaa0e1bd16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:06:55Z,use_quota=True,user_id='7c875b8d8c7b4f7081e6e42ceef3c644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Creating volume c87ed3a0-b894-4ad1-a772-b7f6a95c75ca {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:06:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:06:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:54 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca 1073741824 Sep 02 00:06:54 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:55 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca 1073741824" returned: 0 in 0.532s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:55 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca Sep 02 00:06:55 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:55 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:06:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245952e0-6464-44dc-b149-8a336f0bd766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91156c93-afe5-46ad-b968-19ef48859e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:06:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Volume volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca (c87ed3a0-b894-4ad1-a772-b7f6a95c75ca): created successfully Sep 02 00:06:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91156c93-afe5-46ad-b968-19ef48859e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:06:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Flow 'volume_create_manager' (74563375-4321-4fe6-8929-48474e239935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:06:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-deda0a86-4ad1-4327-94c1-2369058a01f8 tempest-VolumesExtendTest-1371660697 None] Created volume successfully. Sep 02 00:06:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:06:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:06:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Creating offline snapshot 68e545c4-c3c8-414a-a677-886871347f7a of volume c87ed3a0-b894-4ad1-a772-b7f6a95c75ca {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:06:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd2a202-1b42-46d8-9028-2a659c197736]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:06:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:57 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca Sep 02 00:06:57 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:57 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:57 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a 1G Sep 02 00:06:57 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:58 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a 1G" returned: 0 in 0.608s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:58 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a Sep 02 00:06:58 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:58 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:58 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a is being set with open permissions: ugo+rw Sep 02 00:06:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:58 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a Sep 02 00:06:58 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:58 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a" returned: 0 in 0.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:58 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.info Sep 02 00:06:58 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:59 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.info" returned: 0 in 0.299s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:59 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.info is being set with open permissions: ugo+rw Sep 02 00:06:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:06:59 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.info Sep 02 00:06:59 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:06:59 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 02 00:06:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.info" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:06:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:06:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ca65743b-71a8-43c4-874d-5e9d5ac53319 tempest-VolumesExtendTest-1371660697 None] Create snapshot completed successfully Sep 02 00:07:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-804a30a2-997f-4bbc-b517-2d72a5f1636f tempest-VolumesExtendTest-1371660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-804a30a2-997f-4bbc-b517-2d72a5f1636f tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[021f55ff-6c1f-4906-b195-62951f5e9957]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:07:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-804a30a2-997f-4bbc-b517-2d72a5f1636f tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:00 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca Sep 02 00:07:00 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:00 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-804a30a2-997f-4bbc-b517-2d72a5f1636f tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-804a30a2-997f-4bbc-b517-2d72a5f1636f tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a 2G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-804a30a2-997f-4bbc-b517-2d72a5f1636f tempest-VolumesExtendTest-1371660697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a 2G" returned: 0 in 0.206s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-804a30a2-997f-4bbc-b517-2d72a5f1636f tempest-VolumesExtendTest-1371660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.717s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-804a30a2-997f-4bbc-b517-2d72a5f1636f tempest-VolumesExtendTest-1371660697 None] Extend volume completed successfully. Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "cinder-68e545c4-c3c8-414a-a677-886871347f7a-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-68e545c4-c3c8-414a-a677-886871347f7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "cinder-quobyte-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-quobyte-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "cinder-quobyte-68e545c4-c3c8-414a-a677-886871347f7a" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-quobyte-68e545c4-c3c8-414a-a677-886871347f7a" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Deleting offline snapshot 68e545c4-c3c8-414a-a677-886871347f7a of volume c87ed3a0-b894-4ad1-a772-b7f6a95c75ca {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] snapshot_file for this snap is: volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9832577a-4ddf-4b5d-a133-0c20130487b4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:07:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:02 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a Sep 02 00:07:02 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:02 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a" returned: 0 in 0.461s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:07:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[803f372b-6910-4305-b642-6d97fec9e0b4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:07:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:02 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca Sep 02 00:07:02 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:02 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" returned: 0 in 0.444s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:02 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a Sep 02 00:07:02 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:03 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a" returned: 0 in 0.497s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:03 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a Sep 02 00:07:03 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:03 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca.68e545c4-c3c8-414a-a677-886871347f7a" returned: 0 in 0.337s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-quobyte-68e545c4-c3c8-414a-a677-886871347f7a" released by "_delete_snapshot" :: held 1.922s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-quobyte-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" released by "delete_snapshot" :: held 1.967s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:03 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Created reservations ['73c16b0b-cbf4-47fe-b4af-2dd4322f8e5c', '36a605b3-e069-494e-b14d-b3af82d07a0e', '2c6780e7-4617-4db7-af03-c56f2e76e6c4', '20b7e7ed-6c67-49bd-8474-4f34e143c6ee'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:07:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Delete snapshot completed successfully. Sep 02 00:07:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f37461e4-221d-4e79-82d4-911e1bb7ccd7 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-68e545c4-c3c8-414a-a677-886871347f7a-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "cinder-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "cinder-quobyte-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-quobyte-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[291cd5dc-ca57-41dc-8501-2eb745d0146c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:05 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca Sep 02 00:07:05 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:05 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" returned: 0 in 0.419s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:05 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca Sep 02 00:07:05 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:05 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-quobyte-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca" released by "delete_volume" :: held 0.773s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Created reservations ['ef85703a-4b06-4f35-9c60-7cbe4a33d9c9', '8c810ec9-a9c5-47dd-bac9-73a95cc7f7d5', '2db07c54-6689-4b98-a67c-259f4a8eff21', 'b81608bc-84be-42e0-9825-ab8f6dba4fa6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:06 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:07:06 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.461s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:07:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Deleted volume successfully. Sep 02 00:07:06 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:07:06 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48a7a2ce-630b-493c-81e6-e80e0a0fc602 tempest-VolumesExtendTest-1371660697 None] Lock "cinder-c87ed3a0-b894-4ad1-a772-b7f6a95c75ca-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:06 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:07 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.464s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:07:07 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:07:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:07:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Flow 'volume_create_manager' (77714090-9f04-4665-bf10-f3887b3ea055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52cc4d48-09ac-4426-9fee-4e92777f26d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52cc4d48-09ac-4426-9fee-4e92777f26d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-313285936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16ff181-ab79-4185-8327-b1e67a23888e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6111a4cb0dbe4139a1893d8b1b775893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:14Z,use_quota=True,user_id='75467f28bddd4f5bbfaf3e0f6889d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b73b773-778a-4223-95f7-c9480343f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b73b773-778a-4223-95f7-c9480343f043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e2c200-5dca-4269-9438-9010e2fc47cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e2c200-5dca-4269-9438-9010e2fc47cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16ff181-ab79-4185-8327-b1e67a23888e', 'volume_name': 'volume-d16ff181-ab79-4185-8327-b1e67a23888e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cfe807-46b6-407d-8f01-fd23e52c6cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cfe807-46b6-407d-8f01-fd23e52c6cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ac19a2-d33d-4d6d-855a-8bb896d09b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:14 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Volume d16ff181-ab79-4185-8327-b1e67a23888e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16ff181-ab79-4185-8327-b1e67a23888e', 'volume_size': 1} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-313285936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16ff181-ab79-4185-8327-b1e67a23888e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6111a4cb0dbe4139a1893d8b1b775893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:14Z,use_quota=True,user_id='75467f28bddd4f5bbfaf3e0f6889d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Creating volume d16ff181-ab79-4185-8327-b1e67a23888e {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:07:14 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:07:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:14 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e 1073741824 Sep 02 00:07:14 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:15 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e 1073741824" returned: 0 in 0.908s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:15 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e Sep 02 00:07:15 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:15 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:07:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ac19a2-d33d-4d6d-855a-8bb896d09b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16ff181-ab79-4185-8327-b1e67a23888e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9c541f-7b87-4f4c-a7e1-74f759a65c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:15 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Volume volume-d16ff181-ab79-4185-8327-b1e67a23888e (d16ff181-ab79-4185-8327-b1e67a23888e): created successfully Sep 02 00:07:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9c541f-7b87-4f4c-a7e1-74f759a65c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Flow 'volume_create_manager' (77714090-9f04-4665-bf10-f3887b3ea055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-480c03f1-f7a6-41dd-9246-9e37a5dd4323 tempest-VolumesListTestJSON-1943116925 None] Created volume successfully. Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Flow 'volume_create_manager' (8f4227cd-140b-4afc-ae7d-25ba4807eb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4673d2-a116-4e44-98a9-815444c6c22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4673d2-a116-4e44-98a9-815444c6c22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1135903196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc09a46-056a-480e-9d27-3337a979147b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b77a2421923472d887a217dd03df4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:16Z,use_quota=True,user_id='3be92d060338421381b58350e96dfd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86f7e63-33d0-40c8-b593-3b7d6573b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86f7e63-33d0-40c8-b593-3b7d6573b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1711cbb6-1daa-42ee-b48b-b16c218e9844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1711cbb6-1daa-42ee-b48b-b16c218e9844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc09a46-056a-480e-9d27-3337a979147b', 'volume_name': 'volume-bcc09a46-056a-480e-9d27-3337a979147b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d902f4d4-acd0-4cd4-b819-56ab69117324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d902f4d4-acd0-4cd4-b819-56ab69117324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc5dfea-f83e-4932-8614-d55a17cd5c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Volume bcc09a46-056a-480e-9d27-3337a979147b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc09a46-056a-480e-9d27-3337a979147b', 'volume_size': 1} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1135903196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc09a46-056a-480e-9d27-3337a979147b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b77a2421923472d887a217dd03df4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:16Z,use_quota=True,user_id='3be92d060338421381b58350e96dfd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Creating volume bcc09a46-056a-480e-9d27-3337a979147b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:07:16 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:16 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b 1073741824 Sep 02 00:07:16 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Flow 'volume_create_manager' (92ff29f4-dd59-42ef-81fa-c021db13714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c426869-6440-46dd-aaf4-d1173e618e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c426869-6440-46dd-aaf4-d1173e618e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1208344975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9918992-9667-46e0-912e-90b5266d1d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b77a2421923472d887a217dd03df4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:17Z,use_quota=True,user_id='3be92d060338421381b58350e96dfd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c75d97e-7e50-4de3-a404-4631fdc228b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c75d97e-7e50-4de3-a404-4631fdc228b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9242d4dd-949b-401b-afa9-07a24e44fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9242d4dd-949b-401b-afa9-07a24e44fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9918992-9667-46e0-912e-90b5266d1d60', 'volume_name': 'volume-c9918992-9667-46e0-912e-90b5266d1d60', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a68090f-4721-49ba-a567-236838e6b77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a68090f-4721-49ba-a567-236838e6b77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5feeeb90-710e-458a-b80c-f37885a89987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Volume c9918992-9667-46e0-912e-90b5266d1d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9918992-9667-46e0-912e-90b5266d1d60', 'volume_size': 1} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:17 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b 1073741824" returned: 0 in 1.162s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:17 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b Sep 02 00:07:17 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Flow 'volume_create_manager' (d780f038-f025-402b-9fb7-5e494465cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee259899-0d46-4f3a-9f07-b34512802219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee259899-0d46-4f3a-9f07-b34512802219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1517574816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbcf308-5dee-4ba9-893d-96bd4096ab93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6111a4cb0dbe4139a1893d8b1b775893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:18Z,use_quota=True,user_id='75467f28bddd4f5bbfaf3e0f6889d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b7bc29-6051-4936-b93a-e9084a26e2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b7bc29-6051-4936-b93a-e9084a26e2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d17d27-8575-466b-b7c7-2bd0e06c9a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d17d27-8575-466b-b7c7-2bd0e06c9a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcbcf308-5dee-4ba9-893d-96bd4096ab93', 'volume_name': 'volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a43b8e-29ba-424b-9043-88b7b442cfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a43b8e-29ba-424b-9043-88b7b442cfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4e7328-e336-4f18-af39-27742eef5c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Volume dcbcf308-5dee-4ba9-893d-96bd4096ab93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93', 'volume_size': 1} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:17 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.904s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1208344975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9918992-9667-46e0-912e-90b5266d1d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b77a2421923472d887a217dd03df4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:17Z,use_quota=True,user_id='3be92d060338421381b58350e96dfd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Creating volume c9918992-9667-46e0-912e-90b5266d1d60 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:07:17 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:07:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc5dfea-f83e-4932-8614-d55a17cd5c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc09a46-056a-480e-9d27-3337a979147b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860517c7-2c9a-4114-a30c-9c669a68b0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:18 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60 1073741824 Sep 02 00:07:18 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Volume volume-bcc09a46-056a-480e-9d27-3337a979147b (bcc09a46-056a-480e-9d27-3337a979147b): created successfully Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860517c7-2c9a-4114-a30c-9c669a68b0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Flow 'volume_create_manager' (8f4227cd-140b-4afc-ae7d-25ba4807eb11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cb822a5c-ac4a-4b09-8464-9f508c097962 tempest-TestServerVolumeAttachmentScenario-354119304 None] Created volume successfully. Sep 02 00:07:18 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60 1073741824" returned: 0 in 0.607s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:18 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60 Sep 02 00:07:18 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:18 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60" returned: 0 in 0.356s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1517574816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbcf308-5dee-4ba9-893d-96bd4096ab93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6111a4cb0dbe4139a1893d8b1b775893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:18Z,use_quota=True,user_id='75467f28bddd4f5bbfaf3e0f6889d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Creating volume dcbcf308-5dee-4ba9-893d-96bd4096ab93 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:07:19 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5feeeb90-710e-458a-b80c-f37885a89987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9918992-9667-46e0-912e-90b5266d1d60', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57035c3d-58b3-424f-8766-da63b49c20fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:19 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 1073741824 Sep 02 00:07:19 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Volume volume-c9918992-9667-46e0-912e-90b5266d1d60 (c9918992-9667-46e0-912e-90b5266d1d60): created successfully Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57035c3d-58b3-424f-8766-da63b49c20fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Flow 'volume_create_manager' (92ff29f4-dd59-42ef-81fa-c021db13714e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-27b3b638-703d-4da7-93a3-8592f3c93588 tempest-TestServerVolumeAttachmentScenario-354119304 None] Created volume successfully. Sep 02 00:07:19 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 1073741824" returned: 0 in 0.714s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:19 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 Sep 02 00:07:19 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:20 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93" returned: 0 in 0.336s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:07:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4e7328-e336-4f18-af39-27742eef5c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bad09fd-b6f3-44fa-8f07-906af05faa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Volume volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 (dcbcf308-5dee-4ba9-893d-96bd4096ab93): created successfully Sep 02 00:07:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bad09fd-b6f3-44fa-8f07-906af05faa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Flow 'volume_create_manager' (d780f038-f025-402b-9fb7-5e494465cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-53cc0d8e-2235-4675-bd47-85a710fc17f8 tempest-VolumesListTestJSON-1943116925 None] Created volume successfully. Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Flow 'volume_create_manager' (e1faf881-bdff-47ff-bddb-dd41b09c18f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2b16de-a71a-4b69-87cc-690912691422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2b16de-a71a-4b69-87cc-690912691422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1252377968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4341ab57-16a3-4049-a911-ffdbd2eadf4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6111a4cb0dbe4139a1893d8b1b775893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:21Z,use_quota=True,user_id='75467f28bddd4f5bbfaf3e0f6889d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b93f867-503a-4c64-b3ad-312131e32c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b93f867-503a-4c64-b3ad-312131e32c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f33fc7d-dbbf-48f0-bb9c-3e5c2d12fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f33fc7d-dbbf-48f0-bb9c-3e5c2d12fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4341ab57-16a3-4049-a911-ffdbd2eadf4a', 'volume_name': 'volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65525a7-3968-492d-84a3-412d2a9ae4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65525a7-3968-492d-84a3-412d2a9ae4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320ece09-6122-4bce-a7cb-ba612be1df6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Volume 4341ab57-16a3-4049-a911-ffdbd2eadf4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a', 'volume_size': 1} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1252377968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4341ab57-16a3-4049-a911-ffdbd2eadf4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6111a4cb0dbe4139a1893d8b1b775893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:21Z,use_quota=True,user_id='75467f28bddd4f5bbfaf3e0f6889d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Creating volume 4341ab57-16a3-4049-a911-ffdbd2eadf4a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:07:21 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:07:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:21 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a 1073741824 Sep 02 00:07:21 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:22 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a 1073741824" returned: 0 in 0.496s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:22 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a Sep 02 00:07:22 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:22 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:07:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320ece09-6122-4bce-a7cb-ba612be1df6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fbc13f-fe53-4a30-b9bc-40796d2ced73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:22 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Volume volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a (4341ab57-16a3-4049-a911-ffdbd2eadf4a): created successfully Sep 02 00:07:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fbc13f-fe53-4a30-b9bc-40796d2ced73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Flow 'volume_create_manager' (e1faf881-bdff-47ff-bddb-dd41b09c18f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ecba881d-776e-400f-b77b-7a88d302182c tempest-VolumesListTestJSON-1943116925 None] Created volume successfully. Sep 02 00:07:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "cinder-4341ab57-16a3-4049-a911-ffdbd2eadf4a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-4341ab57-16a3-4049-a911-ffdbd2eadf4a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "cinder-quobyte-4341ab57-16a3-4049-a911-ffdbd2eadf4a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-quobyte-4341ab57-16a3-4049-a911-ffdbd2eadf4a" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[888fd432-78a8-410f-aa98-2ead80654e75]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:07:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:28 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a Sep 02 00:07:28 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:28 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a" returned: 0 in 0.732s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:28 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a Sep 02 00:07:28 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:29 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-4341ab57-16a3-4049-a911-ffdbd2eadf4a" returned: 0 in 0.401s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-quobyte-4341ab57-16a3-4049-a911-ffdbd2eadf4a" released by "delete_volume" :: held 1.203s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Created reservations ['d0bc5594-b9ad-48ec-b0b4-a894ca8cf6ab', '6ec69c63-ac1c-4677-bf97-e8986bbc5307', 'd72a28ab-dcff-4f8d-a2df-33c3b30cfc70', '069bd5f8-0704-45b6-8c26-4629a26c1b03'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:29 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:07:29 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:29 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.266s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:07:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Deleted volume successfully. Sep 02 00:07:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b6b2d18-e413-4c89-a86d-b7f199fe8b3a tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-4341ab57-16a3-4049-a911-ffdbd2eadf4a-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "cinder-dcbcf308-5dee-4ba9-893d-96bd4096ab93-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-dcbcf308-5dee-4ba9-893d-96bd4096ab93-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "cinder-quobyte-dcbcf308-5dee-4ba9-893d-96bd4096ab93" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-quobyte-dcbcf308-5dee-4ba9-893d-96bd4096ab93" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:30 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3492bcc-c1ed-4414-91bf-ed850c6f5975]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:07:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:30 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 Sep 02 00:07:30 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:30 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:30 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93 Sep 02 00:07:30 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:31 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-dcbcf308-5dee-4ba9-893d-96bd4096ab93" returned: 0 in 0.308s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-quobyte-dcbcf308-5dee-4ba9-893d-96bd4096ab93" released by "delete_volume" :: held 0.766s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Created reservations ['8a15afd3-6652-4a48-827f-6647fd5b9d53', '9a96fc06-48bb-4c52-ba14-877ed1bc869c', 'c1c474b3-93ae-43cc-a97f-ac26c72cb866', '24195597-f185-4db7-adc4-791ff28e3845'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:31 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:07:31 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "cinder-d16ff181-ab79-4185-8327-b1e67a23888e-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-d16ff181-ab79-4185-8327-b1e67a23888e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "cinder-quobyte-d16ff181-ab79-4185-8327-b1e67a23888e" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-quobyte-d16ff181-ab79-4185-8327-b1e67a23888e" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[22325dc5-652d-4bfd-b85f-b96d53da7b68]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:31 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.374s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:07:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Deleted volume successfully. Sep 02 00:07:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-105469e7-3020-485a-9183-33dad7e13288 tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-dcbcf308-5dee-4ba9-893d-96bd4096ab93-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:31 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e Sep 02 00:07:31 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:32 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e" returned: 0 in 0.435s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:32 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e Sep 02 00:07:32 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:32 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d16ff181-ab79-4185-8327-b1e67a23888e" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-quobyte-d16ff181-ab79-4185-8327-b1e67a23888e" released by "delete_volume" :: held 0.755s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Created reservations ['8ea4bb90-03b0-4f2d-a903-2f3d3720b237', '05ee112e-a7cf-47d7-b2eb-20eaae36b5e2', '3c2433fa-ae26-48e5-8e5f-5d9e6ac4dcbf', '951aa5db-bd98-4e6d-9964-4f9ea028da63'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:32 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:07:32 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:32 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.252s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:07:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Deleted volume successfully. Sep 02 00:07:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-640d5b0f-224c-4757-9753-2b59ce43536a tempest-VolumesListTestJSON-1943116925 None] Lock "cinder-d16ff181-ab79-4185-8327-b1e67a23888e-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Flow 'volume_create_manager' (1aeadd09-5e96-4f60-8db3-3076dbcc7280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5489859-0290-46a2-b7bd-b75634f6dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5489859-0290-46a2-b7bd-b75634f6dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-453518522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d4b41f-25dc-47b1-8db0-8d7c41e962a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a08a0669ea4e37a570ee9795e4cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:35Z,use_quota=True,user_id='62ceed8ab68c473899ec214a2eb5d494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ffbfa7-8b8d-4136-b9d6-6ccdac465e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ffbfa7-8b8d-4136-b9d6-6ccdac465e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7814c130-91d8-44ca-8592-21da475371a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7814c130-91d8-44ca-8592-21da475371a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d4b41f-25dc-47b1-8db0-8d7c41e962a1', 'volume_name': 'volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e139307-9b6a-430e-a4c8-6bba7d1dd325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e139307-9b6a-430e-a4c8-6bba7d1dd325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69c135a-1b79-47fc-a1e5-92ba2fb2f3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Volume 04d4b41f-25dc-47b1-8db0-8d7c41e962a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1', 'volume_size': 1} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-453518522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d4b41f-25dc-47b1-8db0-8d7c41e962a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a08a0669ea4e37a570ee9795e4cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:35Z,use_quota=True,user_id='62ceed8ab68c473899ec214a2eb5d494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Creating volume 04d4b41f-25dc-47b1-8db0-8d7c41e962a1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:07:35 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:07:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:35 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 1073741824 Sep 02 00:07:35 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:36 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 1073741824" returned: 0 in 0.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:36 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 Sep 02 00:07:36 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:36 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1" returned: 0 in 0.259s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:07:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69c135a-1b79-47fc-a1e5-92ba2fb2f3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bf5c37-173c-43e3-a6fd-2f4d815878af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Volume volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 (04d4b41f-25dc-47b1-8db0-8d7c41e962a1): created successfully Sep 02 00:07:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bf5c37-173c-43e3-a6fd-2f4d815878af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Flow 'volume_create_manager' (1aeadd09-5e96-4f60-8db3-3076dbcc7280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fd875fed-7018-44ea-bcb7-5722e40a245e tempest-VolumesNegativeTest-299937542 None] Created volume successfully. Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Flow 'volume_create_manager' (1d69119b-0a15-4ef8-b783-b51b8c91c3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808756f6-1c44-424b-be34-70920a94cd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808756f6-1c44-424b-be34-70920a94cd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-889811338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f428937-0dcc-445f-92f6-dafbd4251e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b26a762c2fb49a1b31e5a7de656fb3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:42Z,use_quota=True,user_id='592cb74695054909a56fe0efde8b8e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1681476-1c4c-476a-8450-bc84fa0154e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1681476-1c4c-476a-8450-bc84fa0154e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b363064-10db-4bbc-b55a-f9900336d949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b363064-10db-4bbc-b55a-f9900336d949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f428937-0dcc-445f-92f6-dafbd4251e8f', 'volume_name': 'volume-7f428937-0dcc-445f-92f6-dafbd4251e8f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2f68be-873a-439a-bb20-27576c2ced6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2f68be-873a-439a-bb20-27576c2ced6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7a8618-e389-47b7-adf2-48b744b9f04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Volume 7f428937-0dcc-445f-92f6-dafbd4251e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f428937-0dcc-445f-92f6-dafbd4251e8f', 'volume_size': 1} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-889811338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f428937-0dcc-445f-92f6-dafbd4251e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b26a762c2fb49a1b31e5a7de656fb3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:07:42Z,use_quota=True,user_id='592cb74695054909a56fe0efde8b8e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Creating volume 7f428937-0dcc-445f-92f6-dafbd4251e8f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:07:41 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:07:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:41 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f 1073741824 Sep 02 00:07:41 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:42 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f 1073741824" returned: 0 in 0.497s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:42 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f Sep 02 00:07:42 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:42 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:07:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7a8618-e389-47b7-adf2-48b744b9f04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f428937-0dcc-445f-92f6-dafbd4251e8f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2e2d71-7f02-4b4c-895c-4bf112057950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:07:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Volume volume-7f428937-0dcc-445f-92f6-dafbd4251e8f (7f428937-0dcc-445f-92f6-dafbd4251e8f): created successfully Sep 02 00:07:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2e2d71-7f02-4b4c-895c-4bf112057950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:07:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Flow 'volume_create_manager' (1d69119b-0a15-4ef8-b783-b51b8c91c3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:07:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ab9acd8a-048b-41d6-8e83-ea174d6fb119 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Created volume successfully. Sep 02 00:07:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-7693eeb2-0f47-448f-84c0-0cb29b66ee3c req-12dbcbf5-cb99-44c5-9a52-25674100af2e tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-7693eeb2-0f47-448f-84c0-0cb29b66ee3c req-12dbcbf5-cb99-44c5-9a52-25674100af2e tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-7693eeb2-0f47-448f-84c0-0cb29b66ee3c req-12dbcbf5-cb99-44c5-9a52-25674100af2e tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-7693eeb2-0f47-448f-84c0-0cb29b66ee3c req-12dbcbf5-cb99-44c5-9a52-25674100af2e tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-7f428937-0dcc-445f-92f6-dafbd4251e8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc85567a-ff5a-48a9-85b1-efc83f0f2599', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:07:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-7693eeb2-0f47-448f-84c0-0cb29b66ee3c req-12dbcbf5-cb99-44c5-9a52-25674100af2e tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] attachment_update completed successfully. Sep 02 00:07:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-f057b820-79a5-4d6c-8f0f-63df9a96c5f3 req-69bd929a-763a-4cf3-ba06-1ec3872e67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Terminate volume connection completed successfully. Sep 02 00:07:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-f057b820-79a5-4d6c-8f0f-63df9a96c5f3 req-69bd929a-763a-4cf3-ba06-1ec3872e67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Deleting attachment fc85567a-ff5a-48a9-85b1-efc83f0f2599. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:07:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Acquiring lock "cinder-7f428937-0dcc-445f-92f6-dafbd4251e8f-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "cinder-7f428937-0dcc-445f-92f6-dafbd4251e8f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Acquiring lock "cinder-quobyte-7f428937-0dcc-445f-92f6-dafbd4251e8f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "cinder-quobyte-7f428937-0dcc-445f-92f6-dafbd4251e8f" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:49 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a8f450-fed4-42d4-bf5f-291eef664d30]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:07:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:50 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f Sep 02 00:07:50 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:50 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f" returned: 0 in 0.391s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:50 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f Sep 02 00:07:50 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:50 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7f428937-0dcc-445f-92f6-dafbd4251e8f" returned: 0 in 0.259s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "cinder-quobyte-7f428937-0dcc-445f-92f6-dafbd4251e8f" released by "delete_volume" :: held 0.697s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Created reservations ['e166dd27-2ef2-4ce4-b8bf-086ec0ca9414', '51a0186f-6ead-4154-87a7-b99d217e85b8', 'e199dacb-802a-4c98-9860-1da3d65896c0', '7fab5cb1-3c9f-4f25-b093-449baa33a3d9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:50 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:07:50 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:51 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:51 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:07:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Deleted volume successfully. Sep 02 00:07:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4a75ae5f-c847-41b6-bd56-c024ef3368a6 tempest-TestServerVolumeAttachScenarioOldVersion-1724850862 None] Lock "cinder-7f428937-0dcc-445f-92f6-dafbd4251e8f-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:07:54 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=71,cinder:INSERT=22,cinder:UPDATE=77,cinder:DELETE=8 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:07:54 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=65,cinder:INSERT=18,cinder:UPDATE=96,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:07:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2c76bb99-92e3-42fb-b01d-521b36a6dac7 req-1018de88-753f-4e2e-bec6-fef222b0995a tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2c76bb99-92e3-42fb-b01d-521b36a6dac7 req-1018de88-753f-4e2e-bec6-fef222b0995a tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2c76bb99-92e3-42fb-b01d-521b36a6dac7 req-1018de88-753f-4e2e-bec6-fef222b0995a tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:07:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-2c76bb99-92e3-42fb-b01d-521b36a6dac7 req-1018de88-753f-4e2e-bec6-fef222b0995a tempest-TestServerVolumeAttachmentScenario-354119304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-bcc09a46-056a-480e-9d27-3337a979147b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57593d97-25f0-4545-b480-661aa7f0e287', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:07:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-2c76bb99-92e3-42fb-b01d-521b36a6dac7 req-1018de88-753f-4e2e-bec6-fef222b0995a tempest-TestServerVolumeAttachmentScenario-354119304 None] attachment_update completed successfully. Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Acquiring lock "cinder-04d4b41f-25dc-47b1-8db0-8d7c41e962a1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Lock "cinder-04d4b41f-25dc-47b1-8db0-8d7c41e962a1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Acquiring lock "cinder-quobyte-04d4b41f-25dc-47b1-8db0-8d7c41e962a1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Lock "cinder-quobyte-04d4b41f-25dc-47b1-8db0-8d7c41e962a1" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7a41e6-6e04-47d2-b849-dfe1abfb9435]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:59 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 Sep 02 00:07:59 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:59 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1" returned: 0 in 0.441s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:07:59 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1 Sep 02 00:07:59 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-cef245a3-9aaf-437e-bb35-89bbd1ae6643 req-c1189215-0b11-4f00-9653-94f16dbdf2c0 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-cef245a3-9aaf-437e-bb35-89bbd1ae6643 req-c1189215-0b11-4f00-9653-94f16dbdf2c0 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:07:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-cef245a3-9aaf-437e-bb35-89bbd1ae6643 req-c1189215-0b11-4f00-9653-94f16dbdf2c0 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-cef245a3-9aaf-437e-bb35-89bbd1ae6643 req-c1189215-0b11-4f00-9653-94f16dbdf2c0 tempest-TestServerVolumeAttachmentScenario-354119304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-c9918992-9667-46e0-912e-90b5266d1d60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f39cac8e-e769-4d56-92c8-649d53cce332', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:08:00 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-04d4b41f-25dc-47b1-8db0-8d7c41e962a1" returned: 0 in 0.301s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-cef245a3-9aaf-437e-bb35-89bbd1ae6643 req-c1189215-0b11-4f00-9653-94f16dbdf2c0 tempest-TestServerVolumeAttachmentScenario-354119304 None] attachment_update completed successfully. Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Lock "cinder-quobyte-04d4b41f-25dc-47b1-8db0-8d7c41e962a1" released by "delete_volume" :: held 0.813s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Created reservations ['9b2a2ba3-2e64-4b39-8f7a-8dfbb062d3b1', '150bedc1-8cda-47b7-ba8c-efdd7898c0e2', 'cedee188-1a6d-48b6-9980-c612daaffd2c', '7e3a27bf-288f-4cb3-b128-b3af93d36b8e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:00 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:00 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:00 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.455s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Deleted volume successfully. Sep 02 00:08:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fefb18d8-4b29-4487-bfda-a19f7920ab5f tempest-VolumesNegativeTest-299937542 None] Lock "cinder-04d4b41f-25dc-47b1-8db0-8d7c41e962a1-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-3896e02f-15d2-4838-a2a0-e576e65fdb11 req-354cc85b-9be8-41f8-8ace-193ddb640207 tempest-TestServerVolumeAttachmentScenario-354119304 None] Terminate volume connection completed successfully. Sep 02 00:08:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-3896e02f-15d2-4838-a2a0-e576e65fdb11 req-354cc85b-9be8-41f8-8ace-193ddb640207 tempest-TestServerVolumeAttachmentScenario-354119304 None] Deleting attachment f39cac8e-e769-4d56-92c8-649d53cce332. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:08:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-86e3372a-e30a-4e77-a493-6e2fb7ac5aa5 req-516bf333-e66d-4ac7-ab3b-239b8d0c9423 tempest-TestServerVolumeAttachmentScenario-354119304 None] Terminate volume connection completed successfully. Sep 02 00:08:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-86e3372a-e30a-4e77-a493-6e2fb7ac5aa5 req-516bf333-e66d-4ac7-ab3b-239b8d0c9423 tempest-TestServerVolumeAttachmentScenario-354119304 None] Deleting attachment 57593d97-25f0-4545-b480-661aa7f0e287. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:06 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:06 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:06 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.340s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:08:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:08:12 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=8,cinder:SELECT=12,cinder:INSERT=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:08:14 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=26,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:08:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "cinder-c9918992-9667-46e0-912e-90b5266d1d60-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "cinder-c9918992-9667-46e0-912e-90b5266d1d60-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "cinder-quobyte-c9918992-9667-46e0-912e-90b5266d1d60" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "cinder-quobyte-c9918992-9667-46e0-912e-90b5266d1d60" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62d463e-8a9e-455f-afd9-a12ecaad3895]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:15 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60 Sep 02 00:08:15 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:15 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60" returned: 0 in 0.432s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:15 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60 Sep 02 00:08:15 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:16 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c9918992-9667-46e0-912e-90b5266d1d60" returned: 0 in 0.280s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "cinder-quobyte-c9918992-9667-46e0-912e-90b5266d1d60" released by "delete_volume" :: held 0.770s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Created reservations ['b112593f-8534-4481-aae6-c09c59f8c44b', '7927b73f-969a-4290-853b-4312010f2117', '6861d575-89fc-409d-b42a-29a57abf4379', '8f3e10f9-54c5-456e-baf1-9df87db8f3a7'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:16 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:16 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "cinder-bcc09a46-056a-480e-9d27-3337a979147b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "cinder-bcc09a46-056a-480e-9d27-3337a979147b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "cinder-quobyte-bcc09a46-056a-480e-9d27-3337a979147b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "cinder-quobyte-bcc09a46-056a-480e-9d27-3337a979147b" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab25bcf6-3111-42b2-9d67-b88354d07100]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:16 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.340s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Deleted volume successfully. Sep 02 00:08:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2d8b768c-faf9-4a10-afca-ac6994971513 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "cinder-c9918992-9667-46e0-912e-90b5266d1d60-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:16 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b Sep 02 00:08:16 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:17 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b" returned: 0 in 0.492s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:17 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b Sep 02 00:08:17 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:17 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-bcc09a46-056a-480e-9d27-3337a979147b" returned: 0 in 0.283s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "cinder-quobyte-bcc09a46-056a-480e-9d27-3337a979147b" released by "delete_volume" :: held 0.842s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Created reservations ['82d6269d-78e2-40b6-ae81-25ff591a72a9', '320983c0-6dfc-4e41-a4fd-edeade1b080c', 'd913e1b6-6091-46a9-a54a-0bcab1f0af1d', '1f0ca4dc-2837-41ce-91c9-c1020c5b4dda'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:17 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:17 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:17 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.296s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Deleted volume successfully. Sep 02 00:08:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e1983477-edf0-4d70-9063-5829a228aa47 tempest-TestServerVolumeAttachmentScenario-354119304 None] Lock "cinder-bcc09a46-056a-480e-9d27-3337a979147b-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:08:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=11,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:08:33 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Flow 'volume_create_manager' (13566f05-11a7-401b-88d1-a2fc264aa566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c61b3e-b103-4f0c-a2d0-949f0fd22d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c61b3e-b103-4f0c-a2d0-949f0fd22d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-623369627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cd0bac-de6b-4937-8d23-42e6866a0d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db79241a6a645838aeda34e9d81efd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:34Z,use_quota=True,user_id='fb321ab171624b1c8c85b247139f6a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c5a346-8379-4fbc-84f2-1266d7ed2176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c5a346-8379-4fbc-84f2-1266d7ed2176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4a92d-98b3-4607-aeb5-76efce2ba906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4a92d-98b3-4607-aeb5-76efce2ba906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8cd0bac-de6b-4937-8d23-42e6866a0d5b', 'volume_name': 'volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc16f415-e9e8-4c99-aa29-2bde1dbe5fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc16f415-e9e8-4c99-aa29-2bde1dbe5fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a02a0c7-4d2b-44be-8056-285d7aa3d120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Volume a8cd0bac-de6b-4937-8d23-42e6866a0d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b', 'volume_size': 1} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-623369627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cd0bac-de6b-4937-8d23-42e6866a0d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db79241a6a645838aeda34e9d81efd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:34Z,use_quota=True,user_id='fb321ab171624b1c8c85b247139f6a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Creating volume a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:08:34 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:34 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b 1073741824 Sep 02 00:08:34 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:34 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b 1073741824" returned: 0 in 0.583s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:34 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b Sep 02 00:08:34 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:35 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" returned: 0 in 0.287s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:08:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a02a0c7-4d2b-44be-8056-285d7aa3d120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02c42b5-a53d-40cf-a889-923613e5e9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Volume volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b (a8cd0bac-de6b-4937-8d23-42e6866a0d5b): created successfully Sep 02 00:08:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02c42b5-a53d-40cf-a889-923613e5e9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Flow 'volume_create_manager' (13566f05-11a7-401b-88d1-a2fc264aa566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fc57afe3-1619-42a6-a054-309565525827 tempest-SnapshotDependencyTests-1043508207 None] Created volume successfully. Sep 02 00:08:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Creating offline snapshot 0b55a663-11b6-4fb4-8ce5-11971ed86cf1 of volume a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:08:36 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d72de-e178-49b0-b27a-9ffabb3c0531]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:36 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b Sep 02 00:08:36 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:36 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:36 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 1G Sep 02 00:08:36 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:37 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 1G" returned: 0 in 0.489s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:37 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 Sep 02 00:08:37 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:37 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:37 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 is being set with open permissions: ugo+rw Sep 02 00:08:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:37 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 Sep 02 00:08:37 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:37 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:38 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.info Sep 02 00:08:38 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:38 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.info" returned: 0 in 0.283s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:38 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.info is being set with open permissions: ugo+rw Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:38 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.info Sep 02 00:08:38 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (e6ae1fec-841b-485f-b394-8b8fdb65d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:38 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee18c5b-a0cb-40a1-884c-1324765a077c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.info" returned: 0 in 0.375s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee18c5b-a0cb-40a1-884c-1324765a077c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-517319224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087fb3f6-c30f-41f1-8748-dfa3cd2bb10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:39Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7066fc5-c167-47cf-a126-62f4b03d84eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7066fc5-c167-47cf-a126-62f4b03d84eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151b8fe5-8d1c-492e-b567-cdb92c216e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151b8fe5-8d1c-492e-b567-cdb92c216e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087fb3f6-c30f-41f1-8748-dfa3cd2bb10b', 'volume_name': 'volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27e65fe-2a43-4345-aea1-66bb48fe264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27e65fe-2a43-4345-aea1-66bb48fe264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb71faf-d8bf-452a-9c25-f985f35328bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Volume 087fb3f6-c30f-41f1-8748-dfa3cd2bb10b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b', 'volume_size': 1} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-517319224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087fb3f6-c30f-41f1-8748-dfa3cd2bb10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:39Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Creating volume 087fb3f6-c30f-41f1-8748-dfa3cd2bb10b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:08:38 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:08:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d0da4655-2e7e-4230-9c72-1cbcee13da27 tempest-SnapshotDependencyTests-1043508207 None] Create snapshot completed successfully Sep 02 00:08:38 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b 1073741824 Sep 02 00:08:38 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (3a88b6b0-250c-49dd-922b-a12e0eafb4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ce32a7-a525-498f-9e84-1ca4feef584e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ce32a7-a525-498f-9e84-1ca4feef584e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-562663318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bc312e-5dae-44c9-a280-533f00fdb1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:39Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b14a5a-f5cc-499e-b9b3-b98da81c1bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b14a5a-f5cc-499e-b9b3-b98da81c1bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a576856-5634-42b1-9299-57e8e46e0141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a576856-5634-42b1-9299-57e8e46e0141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1bc312e-5dae-44c9-a280-533f00fdb1d7', 'volume_name': 'volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e5057c-4949-457f-869c-3ee258efec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e5057c-4949-457f-869c-3ee258efec6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9bc891-aeb4-4870-91f7-04fd38367008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Volume f1bc312e-5dae-44c9-a280-533f00fdb1d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7', 'volume_size': 1} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (848fc5ae-e045-4092-9179-77632a633cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ffe566-10e5-4834-992d-c30eef45b4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ffe566-10e5-4834-992d-c30eef45b4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1955164672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79945294-406a-4044-9f42-132ad80ae1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:39Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53a50ee-6e7f-4e1f-8d04-8d532ce40011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53a50ee-6e7f-4e1f-8d04-8d532ce40011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bfa0b9-49e5-4bf8-abe0-985ccf018738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bfa0b9-49e5-4bf8-abe0-985ccf018738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79945294-406a-4044-9f42-132ad80ae1f5', 'volume_name': 'volume-79945294-406a-4044-9f42-132ad80ae1f5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c1d3ae-fa39-4b42-af98-71f7165b0b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c1d3ae-fa39-4b42-af98-71f7165b0b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21daf51a-7360-4d97-948f-3770062afe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:39 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Volume 79945294-406a-4044-9f42-132ad80ae1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79945294-406a-4044-9f42-132ad80ae1f5', 'volume_size': 1} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:39 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b 1073741824" returned: 0 in 0.717s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:39 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b Sep 02 00:08:39 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:39 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-562663318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bc312e-5dae-44c9-a280-533f00fdb1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:39Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Creating volume f1bc312e-5dae-44c9-a280-533f00fdb1d7 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:08:40 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb71faf-d8bf-452a-9c25-f985f35328bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:40 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 1073741824 Sep 02 00:08:40 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6d08dd-3588-41c6-a889-19f6403c4d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (06150777-9048-4f49-a7ea-b2e39c4c833b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125b5839-11a5-4f92-b6c8-704030c70e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Volume volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b (087fb3f6-c30f-41f1-8748-dfa3cd2bb10b): created successfully Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6d08dd-3588-41c6-a889-19f6403c4d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (e6ae1fec-841b-485f-b394-8b8fdb65d475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125b5839-11a5-4f92-b6c8-704030c70e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-338428445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bae2707-71c0-4b20-8439-e580a16f396d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:40Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46001856-bfe3-4b00-96fd-432145c9f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46001856-bfe3-4b00-96fd-432145c9f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03e1930-6bab-4e49-b8da-d4da78e05e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03e1930-6bab-4e49-b8da-d4da78e05e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bae2707-71c0-4b20-8439-e580a16f396d', 'volume_name': 'volume-8bae2707-71c0-4b20-8439-e580a16f396d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04670f7b-86d6-48b6-8985-9fea3dd4a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04670f7b-86d6-48b6-8985-9fea3dd4a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fa779d-3cfd-4eab-a33a-0d90598313f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Volume 8bae2707-71c0-4b20-8439-e580a16f396d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bae2707-71c0-4b20-8439-e580a16f396d', 'volume_size': 1} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cfe982fc-4225-405f-9e1b-86e7a9cbbdab tempest-CreateVolumesFromImageTest-1817513797 None] Created volume successfully. Sep 02 00:08:40 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 1073741824" returned: 0 in 0.630s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:40 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 Sep 02 00:08:40 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (a92e2d52-efcf-49a8-b6c3-6e363fa396b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cca8fe-a434-475f-813a-ab24b1ca063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Flow 'volume_create_manager' (81897286-8b14-4a11-a0f3-e6cc129507c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a7e8d-0d20-4e8d-a08e-1fc8d69747c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cca8fe-a434-475f-813a-ab24b1ca063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829015137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323b5200-b26f-482e-af96-b20115258fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:41Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f05f76-9f04-4ea7-b94d-adfde217f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f05f76-9f04-4ea7-b94d-adfde217f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1720d797-28f2-4a81-910a-b4ead0459326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1720d797-28f2-4a81-910a-b4ead0459326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323b5200-b26f-482e-af96-b20115258fab', 'volume_name': 'volume-323b5200-b26f-482e-af96-b20115258fab', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466336a3-3144-4cc5-b4e0-1a1af08720fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466336a3-3144-4cc5-b4e0-1a1af08720fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a7dcc5-538f-4a75-a754-7f7185afd390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Volume 323b5200-b26f-482e-af96-b20115258fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323b5200-b26f-482e-af96-b20115258fab', 'volume_size': 1} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a7e8d-0d20-4e8d-a08e-1fc8d69747c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc6dffb-bd48-4110-abd9-0e953e64cc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db79241a6a645838aeda34e9d81efd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b55a663-11b6-4fb4-8ce5-11971ed86cf1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:41Z,use_quota=True,user_id='fb321ab171624b1c8c85b247139f6a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd732ae-3d33-4b23-9b2a-a20e4e5b0ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd732ae-3d33-4b23-9b2a-a20e4e5b0ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e434023c-913e-4f51-9a16-acac6074dfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e434023c-913e-4f51-9a16-acac6074dfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fdc6dffb-bd48-4110-abd9-0e953e64cc3d', 'volume_name': 'volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d', 'volume_size': 1, 'snapshot_id': '0b55a663-11b6-4fb4-8ce5-11971ed86cf1'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3d9592-99a4-475d-9499-b8d676246a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3d9592-99a4-475d-9499-b8d676246a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acce8815-b309-4780-b83a-5017fdc74b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Volume fdc6dffb-bd48-4110-abd9-0e953e64cc3d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d', 'volume_size': 1, 'snapshot_id': '0b55a663-11b6-4fb4-8ce5-11971ed86cf1'} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1955164672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79945294-406a-4044-9f42-132ad80ae1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:39Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Creating volume 79945294-406a-4044-9f42-132ad80ae1f5 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:08:41 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9bc891-aeb4-4870-91f7-04fd38367008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c028f9-9b95-4005-a91b-1034ea7593fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:41 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5 1073741824 Sep 02 00:08:41 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Volume volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 (f1bc312e-5dae-44c9-a280-533f00fdb1d7): created successfully Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c028f9-9b95-4005-a91b-1034ea7593fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (3a88b6b0-250c-49dd-922b-a12e0eafb4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-52c3234d-cb99-429b-a0ef-240f63d7a9d4 tempest-CreateVolumesFromImageTest-1817513797 None] Created volume successfully. Sep 02 00:08:41 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5 1073741824" returned: 0 in 0.520s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:41 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5 Sep 02 00:08:41 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:41 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5" returned: 0 in 0.249s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.580s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-338428445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bae2707-71c0-4b20-8439-e580a16f396d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:40Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Creating volume 8bae2707-71c0-4b20-8439-e580a16f396d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:08:41 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:08:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:42 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d 1073741824 Sep 02 00:08:42 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21daf51a-7360-4d97-948f-3770062afe69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79945294-406a-4044-9f42-132ad80ae1f5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8ef463-fa35-47a1-a8fc-c6ca6ab43044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Volume volume-79945294-406a-4044-9f42-132ad80ae1f5 (79945294-406a-4044-9f42-132ad80ae1f5): created successfully Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8ef463-fa35-47a1-a8fc-c6ca6ab43044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (848fc5ae-e045-4092-9179-77632a633cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9b4cc3b8-d25b-45dc-b9ca-875e94c1a9f9 tempest-CreateVolumesFromImageTest-1817513797 None] Created volume successfully. Sep 02 00:08:42 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d 1073741824" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:42 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d Sep 02 00:08:42 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:42 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.765s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829015137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323b5200-b26f-482e-af96-b20115258fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5850480ac8542aab31a7331c887d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:41Z,use_quota=True,user_id='d71b94fc50f745ed9f18d09486111263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Creating volume 323b5200-b26f-482e-af96-b20115258fab {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:08:42 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fa779d-3cfd-4eab-a33a-0d90598313f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bae2707-71c0-4b20-8439-e580a16f396d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:42 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab 1073741824 Sep 02 00:08:42 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40141ce0-caa2-45d1-b8a1-2348e5bb9cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Volume volume-8bae2707-71c0-4b20-8439-e580a16f396d (8bae2707-71c0-4b20-8439-e580a16f396d): created successfully Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40141ce0-caa2-45d1-b8a1-2348e5bb9cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (06150777-9048-4f49-a7ea-b2e39c4c833b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5b0de4f1-8d44-4123-92c9-ea1df3229a3f tempest-CreateVolumesFromImageTest-1817513797 None] Created volume successfully. Sep 02 00:08:43 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab 1073741824" returned: 0 in 0.461s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:43 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab Sep 02 00:08:43 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:43 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab" returned: 0 in 0.252s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.402s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "cinder-quobyte-0b55a663-11b6-4fb4-8ce5-11971ed86cf1-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a7dcc5-538f-4a75-a754-7f7185afd390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323b5200-b26f-482e-af96-b20115258fab', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88265ca1-b033-459b-87e3-0576fee97878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-0b55a663-11b6-4fb4-8ce5-11971ed86cf1-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Creating volume fdc6dffb-bd48-4110-abd9-0e953e64cc3d from snapshot 0b55a663-11b6-4fb4-8ce5-11971ed86cf1 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "cinder-quobyte-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:43 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Volume volume-323b5200-b26f-482e-af96-b20115258fab (323b5200-b26f-482e-af96-b20115258fab): created successfully Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88265ca1-b033-459b-87e3-0576fee97878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Flow 'volume_create_manager' (a92e2d52-efcf-49a8-b6c3-6e363fa396b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] snapshot: 0b55a663-11b6-4fb4-8ce5-11971ed86cf1, volume: fdc6dffb-bd48-4110-abd9-0e953e64cc3d, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:08:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-53da8caa-c8dd-42a4-85ea-ec832cba68e6 tempest-CreateVolumesFromImageTest-1817513797 None] Created volume successfully. Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee92d47-cb9c-451d-9331-9a44ebc659bf]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:43 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 Sep 02 00:08:43 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-323b5200-b26f-482e-af96-b20115258fab-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-323b5200-b26f-482e-af96-b20115258fab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-quobyte-323b5200-b26f-482e-af96-b20115258fab" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-323b5200-b26f-482e-af96-b20115258fab" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:44 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1" returned: 0 in 0.438s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eae39c-68a8-4bd0-b69b-363012264e0f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4705b-efbb-4e17-929d-76c1c1754ec0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:44 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab Sep 02 00:08:44 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:44 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b Sep 02 00:08:44 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:44 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" returned: 0 in 0.401s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:08:44 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:44 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d Sep 02 00:08:44 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:44 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab Sep 02 00:08:44 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:44 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-323b5200-b26f-482e-af96-b20115258fab" returned: 0 in 0.318s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-323b5200-b26f-482e-af96-b20115258fab" released by "delete_volume" :: held 0.816s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Created reservations ['f186201c-662f-476c-b157-842885efe1ea', 'b584b95e-6c82-4bfe-8e03-9a81464a3909', '45116c5d-bb93-4c12-8882-ef412c39f834', 'c2919182-100f-48be-af30-db81a29fe846'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:45 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:45 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-8bae2707-71c0-4b20-8439-e580a16f396d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-8bae2707-71c0-4b20-8439-e580a16f396d-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-quobyte-8bae2707-71c0-4b20-8439-e580a16f396d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:45 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Deleted volume successfully. Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-8bae2707-71c0-4b20-8439-e580a16f396d" acquired by "delete_volume" :: waited 0.080s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8f329-4b58-4c7b-8366-99d27077c2dc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce8da19c-aabe-4b4c-a11d-8d3bc35061e7 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-323b5200-b26f-482e-af96-b20115258fab-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:46 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d Sep 02 00:08:46 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:47 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d" returned: 0 in 1.261s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:47 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d Sep 02 00:08:47 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:47 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8bae2707-71c0-4b20-8439-e580a16f396d" returned: 0 in 0.468s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-8bae2707-71c0-4b20-8439-e580a16f396d" released by "delete_volume" :: held 1.846s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Created reservations ['8ddd92e9-b03f-4032-b062-37d85cb2593e', '3a81249f-0bd0-466c-bf93-93f3e99f78fc', '2424b8ba-b216-4daf-937b-a9d02f42f9e8', '83cabc74-7a8a-4851-96ad-81aa6d5ae7a1'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-79945294-406a-4044-9f42-132ad80ae1f5-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:48 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:48 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-79945294-406a-4044-9f42-132ad80ae1f5-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-quobyte-79945294-406a-4044-9f42-132ad80ae1f5" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-79945294-406a-4044-9f42-132ad80ae1f5" acquired by "delete_volume" :: waited 0.078s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e8d0e1-8346-4a77-a0d5-c531e7674ad9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:48 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5 Sep 02 00:08:48 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:48 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.780s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:48 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Deleted volume successfully. Sep 02 00:08:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f2503b7b-5119-4202-9522-ae54fa6816d9 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-8bae2707-71c0-4b20-8439-e580a16f396d-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:49 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5" returned: 0 in 0.873s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:49 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5 Sep 02 00:08:49 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:49 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-79945294-406a-4044-9f42-132ad80ae1f5" returned: 0 in 0.674s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-79945294-406a-4044-9f42-132ad80ae1f5" released by "delete_volume" :: held 1.640s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Created reservations ['43eabe7f-1146-468b-80f0-45439fc10497', '6d9e860c-2380-4a55-a299-19fb831fb3f9', 'd3e97ce7-bd2e-4052-b9e8-9e2a34f2210f', '12f4c30e-82d2-4ff0-98bc-d9d10d905c3d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:50 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:50 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-f1bc312e-5dae-44c9-a280-533f00fdb1d7-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-f1bc312e-5dae-44c9-a280-533f00fdb1d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:50 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" returned: 0 in 6.035s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:08:50 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Converted 1024.00 MB image at 169.66 MB/s Sep 02 00:08:50 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d is being set with open permissions: ugo+rw Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:50 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-quobyte-f1bc312e-5dae-44c9-a280-533f00fdb1d7" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.509s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Deleted volume successfully. Sep 02 00:08:50 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d Sep 02 00:08:50 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-f1bc312e-5dae-44c9-a280-533f00fdb1d7" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6b7862f6-e122-49b3-9819-d22b89e15cba tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-79945294-406a-4044-9f42-132ad80ae1f5-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcf1d35-68c9-40ad-ac5c-b995bed6bb5a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:50 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 Sep 02 00:08:50 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:50 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" returned: 0 in 0.293s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" released by "_copy_volume_from_snapshot" :: held 7.309s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-0b55a663-11b6-4fb4-8ce5-11971ed86cf1-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" released by "_create_volume_from_snapshot" :: held 7.404s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.446s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acce8815-b309-4780-b83a-5017fdc74b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d', 'volume_size': 1, 'snapshot_id': '0b55a663-11b6-4fb4-8ce5-11971ed86cf1'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05f3731-beb9-4fea-a617-90bb46046a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Volume volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d (fdc6dffb-bd48-4110-abd9-0e953e64cc3d): created successfully Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05f3731-beb9-4fea-a617-90bb46046a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Flow 'volume_create_manager' (81897286-8b14-4a11-a0f3-e6cc129507c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-10c6a7a4-53a4-4402-a2c9-ff74a240b387 tempest-SnapshotDependencyTests-1043508207 None] Created volume successfully. Sep 02 00:08:51 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:51 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7 Sep 02 00:08:51 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:51 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-f1bc312e-5dae-44c9-a280-533f00fdb1d7" returned: 0 in 0.264s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-f1bc312e-5dae-44c9-a280-533f00fdb1d7" released by "delete_volume" :: held 0.768s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Created reservations ['ba09962b-1135-4f65-92a8-cf523b214d91', '41304e9b-00b8-4dff-a8ce-f6e8ce3a11f3', '1f07cf72-32bf-4309-ab2a-5310941a9bc7', '51b4597f-4e5c-4b5b-acb9-e0488bb0cde8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:51 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:51 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "cinder-0b55a663-11b6-4fb4-8ce5-11971ed86cf1-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-0b55a663-11b6-4fb4-8ce5-11971ed86cf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "cinder-quobyte-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "cinder-quobyte-0b55a663-11b6-4fb4-8ce5-11971ed86cf1" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "cinder-quobyte-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-0b55a663-11b6-4fb4-8ce5-11971ed86cf1" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Deleting offline snapshot 0b55a663-11b6-4fb4-8ce5-11971ed86cf1 of volume a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] snapshot_file for this snap is: volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b" acquired by "delete_volume" :: waited 0.064s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[64610482-c8df-4ef0-9424-4cd8cbe44686]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:52 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c551a3e8-55a6-4973-855e-c571e8b21c5b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Deleted volume successfully. Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-26092184-e6ad-4bd0-936f-72651d95c1f0 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-f1bc312e-5dae-44c9-a280-533f00fdb1d7-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:52 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 Sep 02 00:08:52 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:52 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b Sep 02 00:08:52 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:52 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b" returned: 0 in 0.395s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:52 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1" returned: 0 in 0.433s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:08:52 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b Sep 02 00:08:52 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f17f6-006c-450b-b89b-adc07050f60e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:52 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b Sep 02 00:08:52 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:52 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b" returned: 0 in 0.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-quobyte-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b" released by "delete_volume" :: held 0.734s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Created reservations ['287a057e-64d1-4942-9432-ede4a88f595c', '1092ecc2-b32c-43c1-b7a4-72d91a62626e', '92757bbd-7755-4e64-bda2-a4aada7fe92b', '91ab5bca-cc5a-4f2e-95c3-ccf4479888c2'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:52 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:52 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:53 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" returned: 0 in 0.684s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:53 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Deleted volume successfully. Sep 02 00:08:53 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 Sep 02 00:08:53 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d5183740-cd61-461e-8232-af6a71bce399 tempest-CreateVolumesFromImageTest-1817513797 None] Lock "cinder-087fb3f6-c30f-41f1-8748-dfa3cd2bb10b-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Flow 'volume_create_manager' (6e25a6bd-ae21-4657-bfc5-3cefbbd949ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e611713-bee7-46be-8815-acefd7ec232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e611713-bee7-46be-8815-acefd7ec232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1856351574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874d5e64-78c1-4f0f-aaaf-b2c7aff16441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ac7fa802044cee967f7d57736ab1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:53Z,use_quota=True,user_id='2215dcae12fc4d7081cd364dc9d058da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45072c43-9b0e-4a53-af24-873c8ee89421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45072c43-9b0e-4a53-af24-873c8ee89421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4442e2a4-b8b3-4190-9317-ca75dc2ffe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:08:53 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1" returned: 0 in 0.409s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:53 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1 Sep 02 00:08:53 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4442e2a4-b8b3-4190-9317-ca75dc2ffe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '874d5e64-78c1-4f0f-aaaf-b2c7aff16441', 'volume_name': 'volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dafdccc-8309-46dc-b1af-772d884a39a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dafdccc-8309-46dc-b1af-772d884a39a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe826d4-24e2-4d4d-a7da-4fab6c26ceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Volume 874d5e64-78c1-4f0f-aaaf-b2c7aff16441: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Trying to clone 874d5e64-78c1-4f0f-aaaf-b2c7aff16441 from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:08:53 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b.0b55a663-11b6-4fb4-8ce5-11971ed86cf1" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-0b55a663-11b6-4fb4-8ce5-11971ed86cf1" released by "_delete_snapshot" :: held 1.964s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" released by "delete_snapshot" :: held 2.007s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Created reservations ['7bbfa33e-ec43-4207-b70c-a49a3b218911', '005dc093-88e7-40b8-ac6a-f8391e89f485', '6fda459f-d73c-473b-8ba5-5cd730386dba', '69ffce67-53c4-4bb1-a6c3-25b95162d8d9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:08:54 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Image download 20.69 MB at 20.69 MB/s Sep 02 00:08:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Delete snapshot completed successfully. Sep 02 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3dd1e24-72a5-4c78-b794-05c2e7aa9bd5 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-0b55a663-11b6-4fb4-8ce5-11971ed86cf1-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b42bc7-27f6-4b24-9344-9c1846ad1bc2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:54 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD Sep 02 00:08:54 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:54 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 is fetched for user 2215dcae12fc4d7081cd364dc9d058da. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:08:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4025740d-39ff-4b86-8721-6c0b11e6bbff]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:54 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD Sep 02 00:08:54 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:55 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1856351574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874d5e64-78c1-4f0f-aaaf-b2c7aff16441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ac7fa802044cee967f7d57736ab1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:53Z,use_quota=True,user_id='2215dcae12fc4d7081cd364dc9d058da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Creating volume 874d5e64-78c1-4f0f-aaaf-b2c7aff16441 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:08:55 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:55 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 1073741824 Sep 02 00:08:55 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "cinder-a8cd0bac-de6b-4937-8d23-42e6866a0d5b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-a8cd0bac-de6b-4937-8d23-42e6866a0d5b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "cinder-quobyte-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6562e5-4238-4009-b547-e467fe503f17]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:55 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b Sep 02 00:08:55 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:55 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 1073741824" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:55 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 Sep 02 00:08:55 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:55 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:55 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b Sep 02 00:08:55 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:55 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441" returned: 0 in 0.266s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Attempting download of 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume 874d5e64-78c1-4f0f-aaaf-b2c7aff16441. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba835ab-6011-4fb7-87f0-46031761a554]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_4fj4qzjj {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:55 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" returned: 0 in 0.279s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-a8cd0bac-de6b-4937-8d23-42e6866a0d5b" released by "delete_volume" :: held 0.775s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Created reservations ['2e2c0bee-2ec0-45dd-b143-71897150e41f', '0800d718-fdee-4288-8669-fb9a09108e67', 'c4e8182b-2373-44e3-8503-6a2abfa28b2b', 'c4b75879-b662-48ba-80c7-7f927b8a37ed'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:56 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_4fj4qzjj Sep 02 00:08:56 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:56 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:56 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (b053cf9c-8a8f-4aae-8f0a-22cfeff6f357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4f3036-1005-4075-90f5-94cfc46c8456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4f3036-1005-4075-90f5-94cfc46c8456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-896959194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:56Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d17b305-ece5-4855-80cb-dc7032f1cc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:56 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d17b305-ece5-4855-80cb-dc7032f1cc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d32558-8d12-496f-b436-412e9ad515a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d32558-8d12-496f-b436-412e9ad515a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c', 'volume_name': 'volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fad4ead-686a-4805-9fb7-4e2129831bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fad4ead-686a-4805-9fb7-4e2129831bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171c1fdb-b049-40b8-b535-4c4cd975aeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c', 'volume_size': 1} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-896959194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:08:56Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Creating volume b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:08:56 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "cinder-fdc6dffb-bd48-4110-abd9-0e953e64cc3d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_4fj4qzjj" returned: 0 in 0.422s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_4fj4qzjj {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:56 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c 1073741824 Sep 02 00:08:56 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-fdc6dffb-bd48-4110-abd9-0e953e64cc3d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "cinder-quobyte-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5135b43a-1c7f-4806-852a-cf2fc5f04dd2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:56 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_4fj4qzjj Sep 02 00:08:56 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:56 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.369s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Deleted volume successfully. Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-45a4d671-b4ff-4228-b962-e162177842c4 tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-a8cd0bac-de6b-4937-8d23-42e6866a0d5b-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:56 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d Sep 02 00:08:56 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:56 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_4fj4qzjj" returned: 1 in 0.394s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ac8008a-9a50-4a29-8129-58d061cbfda5_4fj4qzjj' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b37d6f-49df-47ee-8537-f2fc1fd81b53]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:56 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c 1073741824" returned: 0 in 0.517s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:56 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:56 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD Sep 02 00:08:56 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:56 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d Sep 02 00:08:56 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:56 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c Sep 02 00:08:56 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:57 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] 7ac8008a-9a50-4a29-8129-58d061cbfda5 was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:57 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:57 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 Sep 02 00:08:57 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-quobyte-fdc6dffb-bd48-4110-abd9-0e953e64cc3d" released by "delete_volume" :: held 0.713s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:57 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" returned: 0 in 0.294s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171c1fdb-b049-40b8-b535-4c4cd975aeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e37f5a-e676-4a9b-9b3f-8234ceac1842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:57 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c (b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c): created successfully Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e37f5a-e676-4a9b-9b3f-8234ceac1842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (b053cf9c-8a8f-4aae-8f0a-22cfeff6f357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Created reservations ['86d202e3-1999-408b-9bce-e6c70ebd91f7', '124973d7-c000-4d97-bbdb-7a71839dcbc1', '1757ebe0-4f4d-49a5-99e4-efbeb5976e66', 'd5f8cf0f-f40f-429a-9bc5-6357d5da9f9f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:08:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1efc1fa1-7c08-4806-b117-42b14d6f0b22 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created volume successfully. Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:57 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:08:57 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:57 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:08:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Deleted volume successfully. Sep 02 00:08:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b48a38e9-aa4e-4a22-bc5c-6d5e75e3d57c tempest-SnapshotDependencyTests-1043508207 None] Lock "cinder-fdc6dffb-bd48-4110-abd9-0e953e64cc3d-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:08:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:08:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:08:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Creating offline snapshot bafc20f2-473f-4859-a9e5-3bdd9fc7d136 of volume b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:08:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[498162e2-7310-49a6-b366-bf33e91183d0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:08:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:58 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c Sep 02 00:08:58 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:59 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441" returned: 0 in 1.902s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ac8008a-9a50-4a29-8129-58d061cbfda5_jg0iesxzdevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:08:59 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Converted 112.00 MB image at 58.84 MB/s Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:59 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 1G Sep 02 00:08:59 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:59 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" returned: 0 in 0.400s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:59 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 1G Sep 02 00:08:59 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:59 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 1G" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Downloaded image 7ac8008a-9a50-4a29-8129-58d061cbfda5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}])) to volume 874d5e64-78c1-4f0f-aaaf-b2c7aff16441 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Temporary image 7ac8008a-9a50-4a29-8129-58d061cbfda5 for user 2215dcae12fc4d7081cd364dc9d058da is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Marking volume 874d5e64-78c1-4f0f-aaaf-b2c7aff16441 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Copying metadata from image 7ac8008a-9a50-4a29-8129-58d061cbfda5 to 874d5e64-78c1-4f0f-aaaf-b2c7aff16441. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Creating volume glance metadata for volume 874d5e64-78c1-4f0f-aaaf-b2c7aff16441 backed by image 7ac8008a-9a50-4a29-8129-58d061cbfda5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe826d4-24e2-4d4d-a7da-4fab6c26ceb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441', 'volume_size': 1, 'image_id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ac8008a-9a50-4a29-8129-58d061cbfda5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6efc01a4d9d4a6bb84dc52d5dbcef04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ac8008a-9a50-4a29-8129-58d061cbfda5', 'created_at': datetime.datetime(2026, 9, 1, 21, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 21, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ac8008a-9a50-4a29-8129-58d061cbfda5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5786cd0-934d-4922-8d1e-2bdbbd6f3fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:08:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Volume volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 (874d5e64-78c1-4f0f-aaaf-b2c7aff16441): created successfully Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5786cd0-934d-4922-8d1e-2bdbbd6f3fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Flow 'volume_create_manager' (6e25a6bd-ae21-4657-bfc5-3cefbbd949ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:08:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1680c195-f378-47fa-bbcc-bf8a1f3c76e0 tempest-TestShelveInstance-233976916 None] Created volume successfully. Sep 02 00:08:59 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 1G" returned: 0 in 0.530s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:59 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 Sep 02 00:08:59 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:08:59 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:08:59 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 is being set with open permissions: ugo+rw Sep 02 00:08:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:08:59 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 Sep 02 00:08:59 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:00 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136" returned: 0 in 0.259s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:00 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.info Sep 02 00:09:00 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:00 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.info" returned: 0 in 0.265s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:00 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.info is being set with open permissions: ugo+rw Sep 02 00:09:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:00 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.info Sep 02 00:09:00 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:00 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.info" returned: 0 in 0.247s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-354de2f9-2c1a-4279-8ba4-3fd08e7fcfcd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Create snapshot completed successfully Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (fcfea293-ab34-441a-9160-281ecfa94674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d26669-6f20-4b6d-9cd0-72654673907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d26669-6f20-4b6d-9cd0-72654673907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-894800002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:02Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c2609b-8c95-4e0e-b558-3b4031a888ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c2609b-8c95-4e0e-b558-3b4031a888ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b72cc18-1539-4066-beeb-aedcabaeacde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b72cc18-1539-4066-beeb-aedcabaeacde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044', 'volume_name': 'volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddab8ebe-dcba-442e-a549-250166bf08c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddab8ebe-dcba-442e-a549-250166bf08c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324a1f2e-6eaa-48f1-87db-aa89edd984b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:02 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume 3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044', 'volume_size': 1} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-894800002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:02Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Creating volume 3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:02 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:02 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 1073741824 Sep 02 00:09:02 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (811e51d7-fd53-4479-80c5-f874baa27741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f97f84-5772-41b8-95fb-9b2536e09f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f97f84-5772-41b8-95fb-9b2536e09f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2096967604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07b1170-0934-4073-90fe-1411463692cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:03Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5158d4c-0d87-4e6b-964a-e7b1837273f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5158d4c-0d87-4e6b-964a-e7b1837273f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a51a87a-c467-4697-a4de-98f2734bfe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a51a87a-c467-4697-a4de-98f2734bfe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e07b1170-0934-4073-90fe-1411463692cd', 'volume_name': 'volume-e07b1170-0934-4073-90fe-1411463692cd', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7842dbd1-f02d-4724-b3fd-455270fe83bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7842dbd1-f02d-4724-b3fd-455270fe83bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac867b29-3909-4d50-9308-03a8011c4d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume e07b1170-0934-4073-90fe-1411463692cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e07b1170-0934-4073-90fe-1411463692cd', 'volume_size': 1} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:03 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 1073741824" returned: 0 in 0.731s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:03 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 Sep 02 00:09:03 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (017b8db1-0cc5-4a82-9c5f-794becdd40fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a21503-913e-469e-9ca7-7985f286904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a21503-913e-469e-9ca7-7985f286904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428021377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226c7872-b9bb-47ab-8dce-65187c580f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:03Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423bc6ed-9380-4883-b964-d0bc4f00a04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423bc6ed-9380-4883-b964-d0bc4f00a04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd18e9b8-9ad4-4757-abf9-2380cfbf9af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd18e9b8-9ad4-4757-abf9-2380cfbf9af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226c7872-b9bb-47ab-8dce-65187c580f00', 'volume_name': 'volume-226c7872-b9bb-47ab-8dce-65187c580f00', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f24729-8dce-4c64-bfc7-2fd5c07d768a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f24729-8dce-4c64-bfc7-2fd5c07d768a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7231b845-fbf3-4c15-a87b-3e1ae32f326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume 226c7872-b9bb-47ab-8dce-65187c580f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226c7872-b9bb-47ab-8dce-65187c580f00', 'volume_size': 1} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:03 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044" returned: 0 in 0.380s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2096967604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07b1170-0934-4073-90fe-1411463692cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:03Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Creating volume e07b1170-0934-4073-90fe-1411463692cd {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:03 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:03 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd 1073741824 Sep 02 00:09:03 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324a1f2e-6eaa-48f1-87db-aa89edd984b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8079c0db-c6e0-442a-9b96-9447dd73c0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 (3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044): created successfully Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8079c0db-c6e0-442a-9b96-9447dd73c0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (fcfea293-ab34-441a-9160-281ecfa94674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ae04d49f-8089-468a-a905-1a34e3856b39 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created volume successfully. Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (69d1cda8-ee43-442c-9aa5-e50abdc10b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51309ed-d6ac-4dc7-951d-d0a0e8aab74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51309ed-d6ac-4dc7-951d-d0a0e8aab74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-473338616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1571a79a-1ba3-47a3-bbad-1ef85746f970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:04Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fc8ee2-32cd-4119-aa35-269b12737c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fc8ee2-32cd-4119-aa35-269b12737c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63b1325-17ac-49c8-a38e-a5e038ddb0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63b1325-17ac-49c8-a38e-a5e038ddb0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1571a79a-1ba3-47a3-bbad-1ef85746f970', 'volume_name': 'volume-1571a79a-1ba3-47a3-bbad-1ef85746f970', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55320187-901f-411a-9182-4f9c2bb558b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55320187-901f-411a-9182-4f9c2bb558b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5025de39-39c9-47cc-a106-016581f790d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume 1571a79a-1ba3-47a3-bbad-1ef85746f970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1571a79a-1ba3-47a3-bbad-1ef85746f970', 'volume_size': 1} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:04 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd 1073741824" returned: 0 in 0.874s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-38ce57d4-f760-441b-bcc1-a77f10d78ee8 req-f34f95c3-b998-4d8b-b0a9-1d35bee3ec67 tempest-TestShelveInstance-233976916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:04 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd Sep 02 00:09:04 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (2935dd13-aeb3-4b19-a8e2-356be8154bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ea91cd-a697-4532-a7a5-7465b959cb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ea91cd-a697-4532-a7a5-7465b959cb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-134526530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cffe91e-774f-4672-b5ec-6af214526710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:05Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115940d8-f410-41a4-9e89-cf50ad9a3952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115940d8-f410-41a4-9e89-cf50ad9a3952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb6e0ec-a0e1-469a-87da-9e96f1ef84cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb6e0ec-a0e1-469a-87da-9e96f1ef84cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cffe91e-774f-4672-b5ec-6af214526710', 'volume_name': 'volume-3cffe91e-774f-4672-b5ec-6af214526710', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6822af64-8028-4e47-876a-e55d37611c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6822af64-8028-4e47-876a-e55d37611c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3815f9-58ce-41fc-bf60-2bbb702d9b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume 3cffe91e-774f-4672-b5ec-6af214526710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cffe91e-774f-4672-b5ec-6af214526710', 'volume_size': 1} Sep 02 00:09:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:05 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428021377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226c7872-b9bb-47ab-8dce-65187c580f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:03Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Creating volume 226c7872-b9bb-47ab-8dce-65187c580f00 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:05 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac867b29-3909-4d50-9308-03a8011c4d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07b1170-0934-4073-90fe-1411463692cd', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff175b8-cf0e-4edd-b33b-eda56f19c0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:05 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00 1073741824 Sep 02 00:09:05 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume volume-e07b1170-0934-4073-90fe-1411463692cd (e07b1170-0934-4073-90fe-1411463692cd): created successfully Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff175b8-cf0e-4edd-b33b-eda56f19c0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (811e51d7-fd53-4479-80c5-f874baa27741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9a52c4d7-7208-4ecc-91af-48025c9d218d tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created volume successfully. Sep 02 00:09:05 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00 1073741824" returned: 0 in 0.596s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:05 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00 Sep 02 00:09:05 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:06 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-473338616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1571a79a-1ba3-47a3-bbad-1ef85746f970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:04Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Creating volume 1571a79a-1ba3-47a3-bbad-1ef85746f970 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7231b845-fbf3-4c15-a87b-3e1ae32f326b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226c7872-b9bb-47ab-8dce-65187c580f00', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:06 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 1073741824 Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5d8ea6-3208-4e54-a6ab-134ad1903aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:06 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume volume-226c7872-b9bb-47ab-8dce-65187c580f00 (226c7872-b9bb-47ab-8dce-65187c580f00): created successfully Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5d8ea6-3208-4e54-a6ab-134ad1903aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (017b8db1-0cc5-4a82-9c5f-794becdd40fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-33c96fb1-15b8-4559-af47-bcc252a40c7e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created volume successfully. Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:06 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:06 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:06 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 1073741824" returned: 0 in 0.489s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:06 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 Sep 02 00:09:06 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:06 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:09:06 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970" returned: 0 in 0.281s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-38ce57d4-f760-441b-bcc1-a77f10d78ee8 req-f34f95c3-b998-4d8b-b0a9-1d35bee3ec67 tempest-TestShelveInstance-233976916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.169s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-38ce57d4-f760-441b-bcc1-a77f10d78ee8 req-f34f95c3-b998-4d8b-b0a9-1d35bee3ec67 tempest-TestShelveInstance-233976916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-134526530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cffe91e-774f-4672-b5ec-6af214526710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cec1d01255b4c6980d071fe404a2595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:05Z,use_quota=True,user_id='7a638339cd5544e8b91b878bf13ad9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Creating volume 3cffe91e-774f-4672-b5ec-6af214526710 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:07 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5025de39-39c9-47cc-a106-016581f790d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1571a79a-1ba3-47a3-bbad-1ef85746f970', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d37ea7-e7c3-45fd-961a-29805d7f9427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:07 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710 1073741824 Sep 02 00:09:07 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 (1571a79a-1ba3-47a3-bbad-1ef85746f970): created successfully Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d37ea7-e7c3-45fd-961a-29805d7f9427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (69d1cda8-ee43-442c-9aa5-e50abdc10b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-60483146-9229-4d75-80bc-28081ff4c0ab tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created volume successfully. Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-38ce57d4-f760-441b-bcc1-a77f10d78ee8 req-f34f95c3-b998-4d8b-b0a9-1d35bee3ec67 tempest-TestShelveInstance-233976916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4aa9171f-7b1d-4d93-80e2-deb1d223cb75', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:09:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-38ce57d4-f760-441b-bcc1-a77f10d78ee8 req-f34f95c3-b998-4d8b-b0a9-1d35bee3ec67 tempest-TestShelveInstance-233976916 None] attachment_update completed successfully. Sep 02 00:09:07 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710 1073741824" returned: 0 in 0.951s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:08 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710 Sep 02 00:09:08 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:08 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710" returned: 0 in 0.302s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3815f9-58ce-41fc-bf60-2bbb702d9b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cffe91e-774f-4672-b5ec-6af214526710', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8431d5-66b1-49d9-a579-001f96c822a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Volume volume-3cffe91e-774f-4672-b5ec-6af214526710 (3cffe91e-774f-4672-b5ec-6af214526710): created successfully Sep 02 00:09:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8431d5-66b1-49d9-a579-001f96c822a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Flow 'volume_create_manager' (2935dd13-aeb3-4b19-a8e2-356be8154bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3aa021b8-32b4-4e47-a46d-47f46eddb071 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created volume successfully. Sep 02 00:09:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-3cffe91e-774f-4672-b5ec-6af214526710-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-3cffe91e-774f-4672-b5ec-6af214526710-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-quobyte-3cffe91e-774f-4672-b5ec-6af214526710" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-3cffe91e-774f-4672-b5ec-6af214526710" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a0318b-851a-4fa0-86ff-b5d0e8c427d1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:09 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710 Sep 02 00:09:09 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:10 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710" returned: 0 in 0.608s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:10 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710 Sep 02 00:09:10 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:10 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3cffe91e-774f-4672-b5ec-6af214526710" returned: 0 in 0.320s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-3cffe91e-774f-4672-b5ec-6af214526710" released by "delete_volume" :: held 1.016s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created reservations ['fac5381f-4e22-4061-9d9a-5a8f27ff374d', 'a6bc8b0b-2944-4f6c-a193-f29ce7772317', '9f26ae1b-872d-4f7a-b1c7-cde57db9065f', '74d1203c-a72f-43b2-8cf9-9adf53cf371d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:10 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:10 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:11 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Deleted volume successfully. Sep 02 00:09:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-349fd081-f043-4d8d-87ba-e79c8cf5d58f tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-3cffe91e-774f-4672-b5ec-6af214526710-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-1571a79a-1ba3-47a3-bbad-1ef85746f970-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-1571a79a-1ba3-47a3-bbad-1ef85746f970-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-quobyte-1571a79a-1ba3-47a3-bbad-1ef85746f970" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-1571a79a-1ba3-47a3-bbad-1ef85746f970" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d79763d-51ca-4ed9-9964-c0fb28f8bcc5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:12 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 Sep 02 00:09:12 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:12 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970" returned: 0 in 0.487s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:12 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970 Sep 02 00:09:12 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:12 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1571a79a-1ba3-47a3-bbad-1ef85746f970" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-1571a79a-1ba3-47a3-bbad-1ef85746f970" released by "delete_volume" :: held 0.812s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created reservations ['762e38f7-3454-4544-969c-0b451ce42f0c', 'ea7289d5-566e-4fda-a198-cd570c63148d', '3884c0ab-fa3a-426f-9422-8c2077775ba5', '1cf90a34-dd2a-47c6-bcb5-0f16a1f7c795'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:12 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:12 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-226c7872-b9bb-47ab-8dce-65187c580f00-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-226c7872-b9bb-47ab-8dce-65187c580f00-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:13 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-quobyte-226c7872-b9bb-47ab-8dce-65187c580f00" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Deleted volume successfully. Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-226c7872-b9bb-47ab-8dce-65187c580f00" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f19bd0e-9bb8-4ea2-955e-e4f53d390bbd tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-1571a79a-1ba3-47a3-bbad-1ef85746f970-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cc9d3d-f16e-4170-89be-0fe172e663ca]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:13 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00 Sep 02 00:09:13 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:13 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:13 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00 Sep 02 00:09:13 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:14 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-226c7872-b9bb-47ab-8dce-65187c580f00" returned: 0 in 0.279s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-226c7872-b9bb-47ab-8dce-65187c580f00" released by "delete_volume" :: held 0.765s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created reservations ['be897d0c-c49d-4985-a7c0-9d66f4ba0686', '5bdc6aec-59bb-4b0d-8f52-ce94201cd925', 'e89f6a54-3d8d-42b5-8ceb-292d4db48226', 'e236328d-a8d2-4a2d-9a22-8bc75b9c5cec'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:14 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:14 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-e07b1170-0934-4073-90fe-1411463692cd-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-e07b1170-0934-4073-90fe-1411463692cd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-quobyte-e07b1170-0934-4073-90fe-1411463692cd" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-e07b1170-0934-4073-90fe-1411463692cd" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecfc410-9e18-40d5-9a97-9f9e9ac0b166]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:14 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.416s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Deleted volume successfully. Sep 02 00:09:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-807b1a2f-fc2c-4a22-89ce-3853d173b421 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-226c7872-b9bb-47ab-8dce-65187c580f00-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:14 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd Sep 02 00:09:14 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:15 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:15 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd Sep 02 00:09:15 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:15 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e07b1170-0934-4073-90fe-1411463692cd" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-e07b1170-0934-4073-90fe-1411463692cd" released by "delete_volume" :: held 0.830s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created reservations ['4456bc53-6a77-44f6-b4fa-20ffe0cc485b', '43af1859-37a5-4e45-9a5c-a6235f620921', '22b9db00-babd-45bc-9f15-903aad3edd0f', 'a9a8bc2c-4f17-44c6-b502-8a85f19243b0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:15 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:15 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-quobyte-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d86af47-7ac5-4d61-bb09-5f5f9f2ac047]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:15 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.386s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:15 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Deleted volume successfully. Sep 02 00:09:16 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 Sep 02 00:09:16 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8d2d0-2916-45cc-8bb9-6a92b7cbf80e tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-e07b1170-0934-4073-90fe-1411463692cd-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:16 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:16 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044 Sep 02 00:09:16 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:16 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044" released by "delete_volume" :: held 0.752s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created reservations ['d1888408-7eaf-4d8b-b5ee-7a169c9dbc75', 'd60f4396-016b-40cf-b085-d7b67eadc658', '96bb7d98-ac54-48fe-a46c-315042367ef9', '6d44da87-2445-4656-b521-1ef75d5c4343'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:16 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:16 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-bafc20f2-473f-4859-a9e5-3bdd9fc7d136-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-bafc20f2-473f-4859-a9e5-3bdd9fc7d136-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-quobyte-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-quobyte-bafc20f2-473f-4859-a9e5-3bdd9fc7d136" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:17 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-bafc20f2-473f-4859-a9e5-3bdd9fc7d136" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Deleting offline snapshot bafc20f2-473f-4859-a9e5-3bdd9fc7d136 of volume b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] snapshot_file for this snap is: volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.312s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Deleted volume successfully. Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a61eaf-496a-4366-87bc-726eb5568753]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20e55372-867a-4bc2-b42b-6fd0cfb1d2f6 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-3223a0e8-9d06-4f1e-8eaf-ee6fdd18f044-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:17 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 Sep 02 00:09:17 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:17 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136" returned: 0 in 0.386s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c1eed2-468b-4b07-9a15-cd1c637368f8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:17 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c Sep 02 00:09:17 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:17 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" returned: 0 in 0.367s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:17 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 Sep 02 00:09:17 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:18 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136" returned: 0 in 0.308s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:18 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136 Sep 02 00:09:18 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:18 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c.bafc20f2-473f-4859-a9e5-3bdd9fc7d136" returned: 0 in 0.254s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-bafc20f2-473f-4859-a9e5-3bdd9fc7d136" released by "_delete_snapshot" :: held 1.428s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" released by "delete_snapshot" :: held 1.455s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created reservations ['721b6887-12af-47de-b643-c97dd177dd5b', '10b23304-63e8-4340-b7ca-97db3a386123', 'eaa57e71-6c29-4d49-93ed-37752bbbaf36', '865b988c-0c82-4bcc-bb9f-0fdb04ffc2c0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Delete snapshot completed successfully. Sep 02 00:09:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77514b21-2dbe-4e0b-a712-4c8e2930e381 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-bafc20f2-473f-4859-a9e5-3bdd9fc7d136-delete_snapshot" released by "delete_snapshot" :: held 1.608s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "cinder-quobyte-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab1ee2-e6ef-4d5d-886b-533c58c77bce]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:19 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c Sep 02 00:09:19 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:19 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" returned: 0 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:19 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c Sep 02 00:09:19 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:19 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" returned: 0 in 0.254s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-quobyte-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c" released by "delete_volume" :: held 0.682s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Created reservations ['d6ecde64-47e0-4c90-bb2f-467027bd84a8', '2570eb84-abc1-42fe-acdb-776f5d861a48', '2494b2ed-705d-4713-8394-c3d5ba9a1735', '8564fbbd-7bcd-4329-b4e4-5ce7c9072420'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:20 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:20 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:20 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.252s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:20 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Deleted volume successfully. Sep 02 00:09:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-77671433-55d0-4718-a1a7-c2520ba81336 tempest-CreateVolumesFromSnapshotTest-1613003316 None] Lock "cinder-b30f94d3-fe5f-4f99-b9fa-6fb6c8ed8b9c-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Flow 'volume_create_manager' (a429f7a1-35ec-4d09-b97b-e14d129ce0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2ce5cc-3cdd-4e2b-b6d8-21f404b4603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2ce5cc-3cdd-4e2b-b6d8-21f404b4603e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941e47f6-9cb1-45e6-9997-7a73b9c606bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff97a8e3b5747dd8b0226783f5e64a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:25Z,use_quota=True,user_id='e01f5f3331504e81bd11a065b05c6d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418d053d-97b2-40c6-b9bb-c690950ff85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418d053d-97b2-40c6-b9bb-c690950ff85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e384f4-af72-42e8-ac8d-57b35e1ba919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e384f4-af72-42e8-ac8d-57b35e1ba919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '941e47f6-9cb1-45e6-9997-7a73b9c606bd', 'volume_name': 'volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd', 'volume_size': 1, 'image_id': 'a429997a-9c41-4273-87bc-42c32cc58913', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a429997a-9c41-4273-87bc-42c32cc58913', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81d0999c57080b8a18b0226433aaef66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ff97a8e3b5747dd8b0226783f5e64a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '124ca7b9fca87773d80e0f81e8f51f5a76701902f6a82ec1a96a6419141457c3319602e80e5276cf6512c5befc3a744081301bb9a14bfd5b766f76599e119a58', 'id': 'a429997a-9c41-4273-87bc-42c32cc58913', 'created_at': datetime.datetime(2026, 9, 1, 22, 9, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 9, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a429997a-9c41-4273-87bc-42c32cc58913/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d15e034-338c-4e3c-be12-b07be121ea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d15e034-338c-4e3c-be12-b07be121ea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb19eaf-99a6-4091-80d7-01288524cc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:25 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Volume 941e47f6-9cb1-45e6-9997-7a73b9c606bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd', 'volume_size': 1, 'image_id': 'a429997a-9c41-4273-87bc-42c32cc58913', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a429997a-9c41-4273-87bc-42c32cc58913', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81d0999c57080b8a18b0226433aaef66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ff97a8e3b5747dd8b0226783f5e64a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '124ca7b9fca87773d80e0f81e8f51f5a76701902f6a82ec1a96a6419141457c3319602e80e5276cf6512c5befc3a744081301bb9a14bfd5b766f76599e119a58', 'id': 'a429997a-9c41-4273-87bc-42c32cc58913', 'created_at': datetime.datetime(2026, 9, 1, 22, 9, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 9, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a429997a-9c41-4273-87bc-42c32cc58913/file', 'properties': {}}, 'image_service': } Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Trying to clone 941e47f6-9cb1-45e6-9997-7a73b9c606bd from image a429997a-9c41-4273-87bc-42c32cc58913 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a429997a-9c41-4273-87bc-42c32cc58913', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:09:25 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:09:25 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Image download 0.00 MB at 0.00 MB/s Sep 02 00:09:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b3929-74a4-4374-a361-6c3c5f3dabe2]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:26 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD Sep 02 00:09:26 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:26 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:26 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD Sep 02 00:09:26 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:26 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD" returned: 1 in 0.376s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:09:26 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Temporary image a429997a-9c41-4273-87bc-42c32cc58913 is fetched for user e01f5f3331504e81bd11a065b05c6d07. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:09:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7715024f-ce4d-4055-b533-2f5db592c6a4]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:27 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD Sep 02 00:09:27 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:27 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:27 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD Sep 02 00:09:27 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:27 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941e47f6-9cb1-45e6-9997-7a73b9c606bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff97a8e3b5747dd8b0226783f5e64a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:25Z,use_quota=True,user_id='e01f5f3331504e81bd11a065b05c6d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Creating volume 941e47f6-9cb1-45e6-9997-7a73b9c606bd {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:27 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:27 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd 1073741824 Sep 02 00:09:27 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:28 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd 1073741824" returned: 0 in 0.411s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:28 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd Sep 02 00:09:28 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:28 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd" returned: 0 in 0.238s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Attempting download of a429997a-9c41-4273-87bc-42c32cc58913 ((None, [{'url': 'file:///opt/stack/data/glance/images/a429997a-9c41-4273-87bc-42c32cc58913', 'metadata': {}}])) to volume 941e47f6-9cb1-45e6-9997-7a73b9c606bd. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0876d817-774e-4fe8-bd59-10f97b044b33]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a429997a-9c41-4273-87bc-42c32cc58913_1o78o5dm {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:28 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a429997a-9c41-4273-87bc-42c32cc58913_1o78o5dm Sep 02 00:09:28 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:28 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a429997a-9c41-4273-87bc-42c32cc58913_1o78o5dm" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a429997a-9c41-4273-87bc-42c32cc58913_1o78o5dm {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:28 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a429997a-9c41-4273-87bc-42c32cc58913_1o78o5dm Sep 02 00:09:28 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:29 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a429997a-9c41-4273-87bc-42c32cc58913_1o78o5dm" returned: 1 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a429997a-9c41-4273-87bc-42c32cc58913_1o78o5dm' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8eaa5b-58c3-4d3f-ad95-cee451651805]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:29 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD Sep 02 00:09:29 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:29 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:29 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD Sep 02 00:09:29 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:29 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] a429997a-9c41-4273-87bc-42c32cc58913 was raw, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:09:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:29 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd Sep 02 00:09:29 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:30 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd" returned: 0 in 0.467s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a429997a-9c41-4273-87bc-42c32cc58913_ceiql_c6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:09:30 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:30 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd 1G Sep 02 00:09:30 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:30 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd 1G" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Downloaded image a429997a-9c41-4273-87bc-42c32cc58913 ((None, [{'url': 'file:///opt/stack/data/glance/images/a429997a-9c41-4273-87bc-42c32cc58913', 'metadata': {}}])) to volume 941e47f6-9cb1-45e6-9997-7a73b9c606bd successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Temporary image a429997a-9c41-4273-87bc-42c32cc58913 for user e01f5f3331504e81bd11a065b05c6d07 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Marking volume 941e47f6-9cb1-45e6-9997-7a73b9c606bd as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=120,cinder:UPDATE=166,cinder:INSERT=51,cinder:DELETE=13 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Copying metadata from image a429997a-9c41-4273-87bc-42c32cc58913 to 941e47f6-9cb1-45e6-9997-7a73b9c606bd. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Creating volume glance metadata for volume 941e47f6-9cb1-45e6-9997-7a73b9c606bd backed by image a429997a-9c41-4273-87bc-42c32cc58913 with: {'image_id': 'a429997a-9c41-4273-87bc-42c32cc58913', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '81d0999c57080b8a18b0226433aaef66', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=166,cinder:SELECT=140,cinder:INSERT=40,cinder:DELETE=16 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb19eaf-99a6-4091-80d7-01288524cc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd', 'volume_size': 1, 'image_id': 'a429997a-9c41-4273-87bc-42c32cc58913', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a429997a-9c41-4273-87bc-42c32cc58913', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81d0999c57080b8a18b0226433aaef66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ff97a8e3b5747dd8b0226783f5e64a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '124ca7b9fca87773d80e0f81e8f51f5a76701902f6a82ec1a96a6419141457c3319602e80e5276cf6512c5befc3a744081301bb9a14bfd5b766f76599e119a58', 'id': 'a429997a-9c41-4273-87bc-42c32cc58913', 'created_at': datetime.datetime(2026, 9, 1, 22, 9, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 9, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a429997a-9c41-4273-87bc-42c32cc58913/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4229fa30-fde8-47d8-b27e-ef0ff5019c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:30 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Volume volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd (941e47f6-9cb1-45e6-9997-7a73b9c606bd): created successfully Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4229fa30-fde8-47d8-b27e-ef0ff5019c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Flow 'volume_create_manager' (a429f7a1-35ec-4d09-b97b-e14d129ce0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c1036a37-306a-416d-9806-2e91561dff41 tempest-VolumeImageDependencyTests-554391231 None] Created volume successfully. Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Acquiring lock "cinder-941e47f6-9cb1-45e6-9997-7a73b9c606bd-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Lock "cinder-941e47f6-9cb1-45e6-9997-7a73b9c606bd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Acquiring lock "cinder-quobyte-941e47f6-9cb1-45e6-9997-7a73b9c606bd" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Lock "cinder-quobyte-941e47f6-9cb1-45e6-9997-7a73b9c606bd" acquired by "delete_volume" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[689617fa-ffde-41ab-b941-47fc2df4ba58]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:31 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd Sep 02 00:09:31 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:31 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd" returned: 0 in 0.357s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:31 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd Sep 02 00:09:31 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:31 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-941e47f6-9cb1-45e6-9997-7a73b9c606bd" returned: 0 in 0.267s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Lock "cinder-quobyte-941e47f6-9cb1-45e6-9997-7a73b9c606bd" released by "delete_volume" :: held 0.665s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Created reservations ['e784bf28-589d-45a4-ad62-b107e55172e3', '77463c2d-8ec4-41c3-8b47-313c87cdc6ee', '92e34344-e667-45d2-9e8f-8cfdd472ee9e', '0b6130a1-79b4-4949-a4be-2d691c032397'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:31 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:31 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:31 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.253s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:32 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Deleted volume successfully. Sep 02 00:09:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce106004-9d0b-48e3-9567-61106a3ab8a2 tempest-VolumeImageDependencyTests-554391231 None] Lock "cinder-941e47f6-9cb1-45e6-9997-7a73b9c606bd-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Flow 'volume_create_manager' (0a72b5ca-98c6-4963-bc8d-eb7fd10aeef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a005e9bd-df83-4ffd-9c23-1f0d128f03d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a005e9bd-df83-4ffd-9c23-1f0d128f03d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e74dcf-756f-4005-a86f-0625c93622b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d300cbf8d2a4d1e9b02d53e66f8788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:35Z,use_quota=True,user_id='d4c222381b6a40b1a3faa817a750bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c642ac-0112-4264-8a8f-375bab0e5e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c642ac-0112-4264-8a8f-375bab0e5e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb955825-8284-4d7b-95dc-de3969fa7a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb955825-8284-4d7b-95dc-de3969fa7a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6e74dcf-756f-4005-a86f-0625c93622b8', 'volume_name': 'volume-b6e74dcf-756f-4005-a86f-0625c93622b8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e23832-6e5a-4554-9963-d6cd63d3adc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e23832-6e5a-4554-9963-d6cd63d3adc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8bbbcc-eff3-4ca4-a009-fa4320e6a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Volume b6e74dcf-756f-4005-a86f-0625c93622b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6e74dcf-756f-4005-a86f-0625c93622b8', 'volume_size': 1} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e74dcf-756f-4005-a86f-0625c93622b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d300cbf8d2a4d1e9b02d53e66f8788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:35Z,use_quota=True,user_id='d4c222381b6a40b1a3faa817a750bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Creating volume b6e74dcf-756f-4005-a86f-0625c93622b8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:35 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:35 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8 1073741824 Sep 02 00:09:35 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:35 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8 1073741824" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:35 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8 Sep 02 00:09:35 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:36 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8" returned: 0 in 0.270s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8bbbcc-eff3-4ca4-a009-fa4320e6a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e74dcf-756f-4005-a86f-0625c93622b8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b418070-54a0-428d-8cd7-dd0dbc5bc385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Volume volume-b6e74dcf-756f-4005-a86f-0625c93622b8 (b6e74dcf-756f-4005-a86f-0625c93622b8): created successfully Sep 02 00:09:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b418070-54a0-428d-8cd7-dd0dbc5bc385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Flow 'volume_create_manager' (0a72b5ca-98c6-4963-bc8d-eb7fd10aeef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-650761bd-8aa3-497e-89d4-6cb5d1420213 tempest-CinderUnicodeTest-862377521 None] Created volume successfully. Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Flow 'volume_create_manager' (0582af2c-d603-4236-99d6-10a1cbf142c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c445c754-96ca-4f3b-ad9b-9b74568c8f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c445c754-96ca-4f3b-ad9b-9b74568c8f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1740002711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c5ba9b-378d-49b1-951d-b6c288b4dea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d300cbf8d2a4d1e9b02d53e66f8788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:38Z,use_quota=True,user_id='d4c222381b6a40b1a3faa817a750bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e477f-be53-45e0-bea1-0aab03330a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e477f-be53-45e0-bea1-0aab03330a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc2cca9-fd63-4b10-87dc-0612ed54f8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc2cca9-fd63-4b10-87dc-0612ed54f8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c5ba9b-378d-49b1-951d-b6c288b4dea2', 'volume_name': 'volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2340511d-d10f-4604-978a-7e1d2e384cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2340511d-d10f-4604-978a-7e1d2e384cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ca8195-48db-45c5-a4a1-e1a237babd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Volume 51c5ba9b-378d-49b1-951d-b6c288b4dea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2', 'volume_size': 1} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1740002711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c5ba9b-378d-49b1-951d-b6c288b4dea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d300cbf8d2a4d1e9b02d53e66f8788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:38Z,use_quota=True,user_id='d4c222381b6a40b1a3faa817a750bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Creating volume 51c5ba9b-378d-49b1-951d-b6c288b4dea2 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:37 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:37 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 1073741824 Sep 02 00:09:37 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:38 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 1073741824" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:38 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 Sep 02 00:09:38 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:38 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2" returned: 0 in 0.271s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ca8195-48db-45c5-a4a1-e1a237babd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de65abc4-69d5-463e-8818-c880e7ba673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Volume volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 (51c5ba9b-378d-49b1-951d-b6c288b4dea2): created successfully Sep 02 00:09:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de65abc4-69d5-463e-8818-c880e7ba673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Flow 'volume_create_manager' (0582af2c-d603-4236-99d6-10a1cbf142c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d4554578-0547-4966-ba99-a2ee6b8c4b59 tempest-CinderUnicodeTest-862377521 None] Created volume successfully. Sep 02 00:09:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Creating offline snapshot 2a13d10c-1a00-4f37-a2ea-074a20cc8a6c of volume 51c5ba9b-378d-49b1-951d-b6c288b4dea2 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:09:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bae996d-3419-43d4-8ff8-64fc98420266]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:39 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 Sep 02 00:09:39 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:39 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2" returned: 0 in 0.386s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:39 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c 1G Sep 02 00:09:39 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:39 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c 1G" returned: 0 in 0.469s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:39 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c Sep 02 00:09:39 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:40 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c" returned: 0 in 0.416s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:40 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c is being set with open permissions: ugo+rw Sep 02 00:09:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:40 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c Sep 02 00:09:40 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:40 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-fcf19503-9a62-4646-9d1b-a48c777fdc5f req-2af4ecfd-0210-4e0f-9012-0b4b13ccd2ba tempest-TestShelveInstance-233976916 None] Terminate volume connection completed successfully. Sep 02 00:09:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-fcf19503-9a62-4646-9d1b-a48c777fdc5f req-2af4ecfd-0210-4e0f-9012-0b4b13ccd2ba tempest-TestShelveInstance-233976916 None] Deleting attachment 4aa9171f-7b1d-4d93-80e2-deb1d223cb75. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:09:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:40 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.info Sep 02 00:09:40 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:41 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.info" returned: 0 in 0.293s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:41 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.info is being set with open permissions: ugo+rw Sep 02 00:09:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:41 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.info Sep 02 00:09:41 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:41 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.info" returned: 0 in 0.266s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-82cd1d2c-4b8c-4bec-bfcb-62e8d779156a tempest-CinderUnicodeTest-862377521 None] Create snapshot completed successfully Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Acquiring lock "cinder-2a13d10c-1a00-4f37-a2ea-074a20cc8a6c-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Lock "cinder-2a13d10c-1a00-4f37-a2ea-074a20cc8a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Acquiring lock "cinder-quobyte-51c5ba9b-378d-49b1-951d-b6c288b4dea2" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Lock "cinder-quobyte-51c5ba9b-378d-49b1-951d-b6c288b4dea2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Acquiring lock "cinder-quobyte-2a13d10c-1a00-4f37-a2ea-074a20cc8a6c" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Lock "cinder-quobyte-2a13d10c-1a00-4f37-a2ea-074a20cc8a6c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Deleting offline snapshot 2a13d10c-1a00-4f37-a2ea-074a20cc8a6c of volume 51c5ba9b-378d-49b1-951d-b6c288b4dea2 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] snapshot_file for this snap is: volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dee6eb8-327d-4246-ba3b-3cf3cb29f7e0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:42 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c Sep 02 00:09:42 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-560d6c16-eaa8-4b06-84aa-6553e581ab5c req-2d4efeb1-cf46-4b6b-8502-1a1879c8b6b0 tempest-TestShelveInstance-233976916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-560d6c16-eaa8-4b06-84aa-6553e581ab5c req-2d4efeb1-cf46-4b6b-8502-1a1879c8b6b0 tempest-TestShelveInstance-233976916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-560d6c16-eaa8-4b06-84aa-6553e581ab5c req-2d4efeb1-cf46-4b6b-8502-1a1879c8b6b0 tempest-TestShelveInstance-233976916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:42 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c" returned: 0 in 0.378s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-560d6c16-eaa8-4b06-84aa-6553e581ab5c req-2d4efeb1-cf46-4b6b-8502-1a1879c8b6b0 tempest-TestShelveInstance-233976916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f', 'name': 'volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '844e54d0-fcda-4791-b003-5337e36a6626', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eedfdf-9521-4401-a580-583267487ab2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-560d6c16-eaa8-4b06-84aa-6553e581ab5c req-2d4efeb1-cf46-4b6b-8502-1a1879c8b6b0 tempest-TestShelveInstance-233976916 None] attachment_update completed successfully. Sep 02 00:09:42 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 Sep 02 00:09:42 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:43 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2" returned: 0 in 0.429s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:43 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c Sep 02 00:09:43 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:43 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c" returned: 0 in 0.385s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:43 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c Sep 02 00:09:43 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:43 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2.2a13d10c-1a00-4f37-a2ea-074a20cc8a6c" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Lock "cinder-quobyte-2a13d10c-1a00-4f37-a2ea-074a20cc8a6c" released by "_delete_snapshot" :: held 1.575s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Lock "cinder-quobyte-51c5ba9b-378d-49b1-951d-b6c288b4dea2" released by "delete_snapshot" :: held 1.599s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Created reservations ['38911723-335d-4f81-ac02-ab70924b8a0b', '745ae6df-fd32-45ce-871a-a0adccc3d7f8', '1de644d6-4dbd-4409-805d-1c5495c7bf5c', 'f6db717f-8456-4a3a-a5b8-26ed4593b8cd'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Delete snapshot completed successfully. Sep 02 00:09:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6326db6-a8d8-41a2-b76b-e0e25ab6ce4f tempest-CinderUnicodeTest-862377521 None] Lock "cinder-2a13d10c-1a00-4f37-a2ea-074a20cc8a6c-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Acquiring lock "cinder-51c5ba9b-378d-49b1-951d-b6c288b4dea2-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Lock "cinder-51c5ba9b-378d-49b1-951d-b6c288b4dea2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Acquiring lock "cinder-quobyte-51c5ba9b-378d-49b1-951d-b6c288b4dea2" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Lock "cinder-quobyte-51c5ba9b-378d-49b1-951d-b6c288b4dea2" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[444b1906-c529-4223-9da4-b510588557a5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:44 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 Sep 02 00:09:44 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:44 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2" returned: 0 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:44 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2 Sep 02 00:09:44 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:45 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-51c5ba9b-378d-49b1-951d-b6c288b4dea2" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Lock "cinder-quobyte-51c5ba9b-378d-49b1-951d-b6c288b4dea2" released by "delete_volume" :: held 0.750s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Created reservations ['3a175ca2-5e0f-49d4-ba95-125adb4a5c09', 'c75b5cca-3d64-4c75-bdb7-432261f4bd6b', 'f987dda0-31d8-49e7-89ed-040d8eebf36e', '4524c1b0-8cfe-49ce-bc2a-0cf0cb167ec3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:45 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:45 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Acquiring lock "cinder-b6e74dcf-756f-4005-a86f-0625c93622b8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Lock "cinder-b6e74dcf-756f-4005-a86f-0625c93622b8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Acquiring lock "cinder-quobyte-b6e74dcf-756f-4005-a86f-0625c93622b8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Lock "cinder-quobyte-b6e74dcf-756f-4005-a86f-0625c93622b8" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:46 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.570s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Deleted volume successfully. Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d49b596-904e-42df-9647-f67008844bf4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1d6c1a50-b2c4-480b-826e-8a86719e34ab tempest-CinderUnicodeTest-862377521 None] Lock "cinder-51c5ba9b-378d-49b1-951d-b6c288b4dea2-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:46 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8 Sep 02 00:09:46 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:46 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8" returned: 0 in 0.564s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:46 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8 Sep 02 00:09:46 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:46 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b6e74dcf-756f-4005-a86f-0625c93622b8" returned: 0 in 0.261s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Lock "cinder-quobyte-b6e74dcf-756f-4005-a86f-0625c93622b8" released by "delete_volume" :: held 0.892s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:46 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Created reservations ['36900c2e-30cc-4fd0-a85b-7d913764b9e1', '3332459d-1b52-4161-8237-1ad13ec0109d', '7bfa88e9-22d1-4190-bdd3-13d6035942f6', '755e367b-ea54-4d5c-b8e7-cf0923f0fd26'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:47 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:47 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:47 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:47 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Deleted volume successfully. Sep 02 00:09:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-558081cc-03e8-43c4-b161-dae3df275539 tempest-CinderUnicodeTest-862377521 None] Lock "cinder-b6e74dcf-756f-4005-a86f-0625c93622b8-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Flow 'volume_create_manager' (793387aa-b2c1-4456-992c-8eedded31fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4792eae-4616-4885-9993-1fe17888c2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4792eae-4616-4885-9993-1fe17888c2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57797339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895c90a0-63d5-4d9b-a3ea-17d6667cc348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fe68a93d2b411bb800b965328ab099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:52Z,use_quota=True,user_id='3bfb0af9732240559f52bb58fc303856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7dc41c7-bc21-4d2a-bbc2-83699387e8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7dc41c7-bc21-4d2a-bbc2-83699387e8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f446b81d-22e9-4d1f-b254-d46c01040cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f446b81d-22e9-4d1f-b254-d46c01040cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895c90a0-63d5-4d9b-a3ea-17d6667cc348', 'volume_name': 'volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8e5c8d-3745-49d1-bb24-775091ea9136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8e5c8d-3745-49d1-bb24-775091ea9136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15b54d6-e6b9-4ad2-adf7-92846793ad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Volume 895c90a0-63d5-4d9b-a3ea-17d6667cc348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348', 'volume_size': 1} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57797339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895c90a0-63d5-4d9b-a3ea-17d6667cc348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fe68a93d2b411bb800b965328ab099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:52Z,use_quota=True,user_id='3bfb0af9732240559f52bb58fc303856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Creating volume 895c90a0-63d5-4d9b-a3ea-17d6667cc348 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:52 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:52 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 1073741824 Sep 02 00:09:52 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:52 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 1073741824" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:52 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 Sep 02 00:09:52 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:52 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15b54d6-e6b9-4ad2-adf7-92846793ad16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4093691-fa04-47ea-9df9-cdb5b805308a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Volume volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 (895c90a0-63d5-4d9b-a3ea-17d6667cc348): created successfully Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4093691-fa04-47ea-9df9-cdb5b805308a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Flow 'volume_create_manager' (793387aa-b2c1-4456-992c-8eedded31fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e6fbff31-d35d-4c85-870d-2d58f0e8b3e8 tempest-ProjectReaderTests-1335541305 None] Created volume successfully. Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Acquiring lock "cinder-895c90a0-63d5-4d9b-a3ea-17d6667cc348-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Lock "cinder-895c90a0-63d5-4d9b-a3ea-17d6667cc348-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Acquiring lock "cinder-quobyte-895c90a0-63d5-4d9b-a3ea-17d6667cc348" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Lock "cinder-quobyte-895c90a0-63d5-4d9b-a3ea-17d6667cc348" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aadf6c4-0494-4a0b-ac95-f087fa48a2e1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:54 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 Sep 02 00:09:54 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:54 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348" returned: 0 in 0.389s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:54 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348 Sep 02 00:09:54 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:54 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-895c90a0-63d5-4d9b-a3ea-17d6667cc348" returned: 0 in 0.248s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Lock "cinder-quobyte-895c90a0-63d5-4d9b-a3ea-17d6667cc348" released by "delete_volume" :: held 0.675s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Created reservations ['43762ed9-2873-44d9-ba02-1f877b2c2874', '8ec12b1a-4d8e-43f7-94bc-03a29c1b1945', '29aac12f-043b-47a7-9d99-14ee56240988', '6aa23328-bbae-430b-b2ab-8c7750b404f8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:55 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:55 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:55 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Deleted volume successfully. Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f0ef3441-f9df-4027-8544-8952f8052fa4 tempest-ProjectReaderTests-1335541305 None] Lock "cinder-895c90a0-63d5-4d9b-a3ea-17d6667cc348-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Flow 'volume_create_manager' (914cf5ee-d76f-4e5c-8dae-69c11b313154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6722ff51-828a-4e04-bca5-b90b716d5d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6722ff51-828a-4e04-bca5-b90b716d5d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387650458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385ea053-2d32-417f-a044-e611493bf38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fe68a93d2b411bb800b965328ab099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:56Z,use_quota=True,user_id='3bfb0af9732240559f52bb58fc303856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887b1852-f4b7-4541-9be6-20f8b11ab37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887b1852-f4b7-4541-9be6-20f8b11ab37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9e3c3f-76c1-428e-a3e3-2d555e02988a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9e3c3f-76c1-428e-a3e3-2d555e02988a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385ea053-2d32-417f-a044-e611493bf38b', 'volume_name': 'volume-385ea053-2d32-417f-a044-e611493bf38b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7ff17a-a9a6-432a-bb43-fb1c0c29edbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7ff17a-a9a6-432a-bb43-fb1c0c29edbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a491706-4e09-4a5d-a977-67e0922bcc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Volume 385ea053-2d32-417f-a044-e611493bf38b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385ea053-2d32-417f-a044-e611493bf38b', 'volume_size': 1} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387650458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385ea053-2d32-417f-a044-e611493bf38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fe68a93d2b411bb800b965328ab099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:09:56Z,use_quota=True,user_id='3bfb0af9732240559f52bb58fc303856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Creating volume 385ea053-2d32-417f-a044-e611493bf38b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:09:55 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:09:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:55 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b 1073741824 Sep 02 00:09:55 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:56 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b 1073741824" returned: 0 in 0.406s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:56 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b Sep 02 00:09:56 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:56 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a491706-4e09-4a5d-a977-67e0922bcc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385ea053-2d32-417f-a044-e611493bf38b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d317e6c-0391-4b50-a421-0445abed61e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:09:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Volume volume-385ea053-2d32-417f-a044-e611493bf38b (385ea053-2d32-417f-a044-e611493bf38b): created successfully Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d317e6c-0391-4b50-a421-0445abed61e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Flow 'volume_create_manager' (914cf5ee-d76f-4e5c-8dae-69c11b313154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:09:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2ba9fa2f-8087-4d27-940f-16383b40c96f tempest-ProjectReaderTests-1335541305 None] Created volume successfully. Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Acquiring lock "cinder-385ea053-2d32-417f-a044-e611493bf38b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Lock "cinder-385ea053-2d32-417f-a044-e611493bf38b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Acquiring lock "cinder-quobyte-385ea053-2d32-417f-a044-e611493bf38b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Lock "cinder-quobyte-385ea053-2d32-417f-a044-e611493bf38b" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ab3c20-ef2e-4153-8c03-597af4429b8b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:57 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b Sep 02 00:09:57 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:57 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b" returned: 0 in 0.371s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:57 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b Sep 02 00:09:57 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:57 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-385ea053-2d32-417f-a044-e611493bf38b" returned: 0 in 0.266s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Lock "cinder-quobyte-385ea053-2d32-417f-a044-e611493bf38b" released by "delete_volume" :: held 0.678s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Created reservations ['fe903e83-2b22-48dc-8c15-62fb8f990147', 'f23dba50-7020-405f-88cc-033bd031583b', 'd621eb42-1ece-4b73-8141-55b725493dba', 'd2064c9f-856c-45ee-b8c5-0ed90789372a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:09:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:09:57 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:09:57 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:09:58 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 02 00:09:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:09:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:09:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Deleted volume successfully. Sep 02 00:09:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d4d56b56-6dac-41f9-a5a5-fd26aa6dc645 tempest-ProjectReaderTests-1335541305 None] Lock "cinder-385ea053-2d32-417f-a044-e611493bf38b-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:06 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:10:06 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:06 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.249s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:10:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:10:07 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=56,cinder:INSERT=23,cinder:UPDATE=59,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:10:08 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=65,cinder:SELECT=51,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:10:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-6732e099-5b72-411d-b485-a7dfcca33aab tempest-TestShelveInstance-233976916 None] Terminate volume connection completed successfully. Sep 02 00:10:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-6732e099-5b72-411d-b485-a7dfcca33aab tempest-TestShelveInstance-233976916 None] Deleting attachment 844e54d0-fcda-4791-b003-5337e36a6626. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:10:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Acquiring lock "cinder-874d5e64-78c1-4f0f-aaaf-b2c7aff16441-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:10:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Lock "cinder-874d5e64-78c1-4f0f-aaaf-b2c7aff16441-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:10:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Acquiring lock "cinder-quobyte-874d5e64-78c1-4f0f-aaaf-b2c7aff16441" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Lock "cinder-quobyte-874d5e64-78c1-4f0f-aaaf-b2c7aff16441" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3913b4-531c-49d2-ac06-fdba42d92590]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:11 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 Sep 02 00:10:11 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:11 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441" returned: 0 in 0.396s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:11 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441 Sep 02 00:10:11 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:11 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-874d5e64-78c1-4f0f-aaaf-b2c7aff16441" returned: 0 in 0.252s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Lock "cinder-quobyte-874d5e64-78c1-4f0f-aaaf-b2c7aff16441" released by "delete_volume" :: held 0.691s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG cinder.quota [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Created reservations ['e3c4aa46-37b4-4aba-a27f-e122a8f795b2', 'f2ddf367-2501-49ca-9d47-559fd6f9dc8e', '4d52f25c-5f09-483c-992a-b5c3f6984e6b', 'b5ea13ee-1cb6-4300-b874-391e86b671a4'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:10:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:11 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:10:11 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:12 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.260s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:12 devstack cinder-volume[86591]: DEBUG cinder.manager [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:10:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Deleted volume successfully. Sep 02 00:10:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ebbad288-9c9f-4fea-af3a-10f25e8bd2ec req-7c8024ea-41d9-4be7-ae0e-8b6aacae4a02 tempest-TestShelveInstance-233976916 None] Lock "cinder-874d5e64-78c1-4f0f-aaaf-b2c7aff16441-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:10:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:10:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Flow 'volume_create_manager' (ed0797a4-a8bd-4502-8573-256df1508547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e181172a-b2e2-41dd-95b6-3551afd5c77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e181172a-b2e2-41dd-95b6-3551afd5c77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1383023694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8984204e-8f81-469e-b8d8-45b5f9b9241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061b71e31cfc49feb75a2f888f89dab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:10:45Z,use_quota=True,user_id='8b4d4206f6ae4b5facafd53e474fc8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22fa6ab-4dc2-4374-b1fc-8a7e747afe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22fa6ab-4dc2-4374-b1fc-8a7e747afe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e547b7c-27d2-4978-83ec-e21039aaa76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e547b7c-27d2-4978-83ec-e21039aaa76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8984204e-8f81-469e-b8d8-45b5f9b9241a', 'volume_name': 'volume-8984204e-8f81-469e-b8d8-45b5f9b9241a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac44330-a16f-480c-9d58-137301561085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac44330-a16f-480c-9d58-137301561085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51c1867-4e90-4fa4-bb9e-742d8019d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:10:45 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Volume 8984204e-8f81-469e-b8d8-45b5f9b9241a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8984204e-8f81-469e-b8d8-45b5f9b9241a', 'volume_size': 1} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1383023694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8984204e-8f81-469e-b8d8-45b5f9b9241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061b71e31cfc49feb75a2f888f89dab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:10:45Z,use_quota=True,user_id='8b4d4206f6ae4b5facafd53e474fc8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Creating volume 8984204e-8f81-469e-b8d8-45b5f9b9241a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:10:45 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:10:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:45 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a 1073741824 Sep 02 00:10:45 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:46 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a 1073741824" returned: 0 in 0.428s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:46 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a Sep 02 00:10:46 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:46 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a" returned: 0 in 0.266s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:10:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:10:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51c1867-4e90-4fa4-bb9e-742d8019d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8984204e-8f81-469e-b8d8-45b5f9b9241a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:10:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efbc4cb-2c55-4d95-9fba-3dc12b251c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:10:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Volume volume-8984204e-8f81-469e-b8d8-45b5f9b9241a (8984204e-8f81-469e-b8d8-45b5f9b9241a): created successfully Sep 02 00:10:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efbc4cb-2c55-4d95-9fba-3dc12b251c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:10:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Flow 'volume_create_manager' (ed0797a4-a8bd-4502-8573-256df1508547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:10:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-70001aea-d2b3-483b-a4be-45e026c240ff tempest-TestImageHashVerification-1647453291 None] Created volume successfully. Sep 02 00:10:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:10:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:10:47 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f19f16-dce5-4e49-9e94-89e21e0afdaf]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:10:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:47 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a Sep 02 00:10:47 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:47 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:47 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3251122-8326-4561-8735-c37db6142bfb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:10:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:47 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a Sep 02 00:10:47 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:48 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a" returned: 0 in 0.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a /opt/stack/data/cinder/conversion/8984204e-8f81-469e-b8d8-45b5f9b9241a.temp_image.883ca0f3-fd91-42df-98b9-0d8fb68571696r44qog0.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:48 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a /opt/stack/data/cinder/conversion/8984204e-8f81-469e-b8d8-45b5f9b9241a.temp_image.883ca0f3-fd91-42df-98b9-0d8fb68571696r44qog0.img Sep 02 00:10:48 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:52 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a /opt/stack/data/cinder/conversion/8984204e-8f81-469e-b8d8-45b5f9b9241a.temp_image.883ca0f3-fd91-42df-98b9-0d8fb68571696r44qog0.img" returned: 0 in 3.962s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ddd1d0-ec4a-467c-9c0c-13956f8f4a24]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:10:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:10:52 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a Sep 02 00:10:52 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:10:52 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 02 00:10:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a" returned: 0 in 0.546s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:10:52 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/conversion/8984204e-8f81-469e-b8d8-45b5f9b9241a.temp_image.883ca0f3-fd91-42df-98b9-0d8fb68571696r44qog0.img {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:10:52 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Converted 1024.00 MB image at 258.35 MB/s Sep 02 00:10:52 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] 883ca0f3-fd91-42df-98b9-0d8fb6857169 was raw, no need to convert to raw {{(pid=86591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 02 00:10:57 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:SELECT=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:11:02 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:06 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:11:06 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:06 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:11:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Uploaded volume to glance image-id: 883ca0f3-fd91-42df-98b9-0d8fb6857169. {{(pid=86591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 00:11:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3baecb50-b641-47fd-bf24-5c723bfbd5cd tempest-TestImageHashVerification-1647453291 None] Copy volume to image completed successfully. Sep 02 00:11:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Acquiring lock "cinder-8984204e-8f81-469e-b8d8-45b5f9b9241a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:11:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Lock "cinder-8984204e-8f81-469e-b8d8-45b5f9b9241a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:11:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Acquiring lock "cinder-quobyte-8984204e-8f81-469e-b8d8-45b5f9b9241a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:11:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Lock "cinder-quobyte-8984204e-8f81-469e-b8d8-45b5f9b9241a" acquired by "delete_volume" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:11:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba2b1a-d698-4e81-9bc0-5e08e1ec43ce]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:12 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a Sep 02 00:11:12 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:12 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:12 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a Sep 02 00:11:12 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:12 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-8984204e-8f81-469e-b8d8-45b5f9b9241a" returned: 0 in 0.237s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Lock "cinder-quobyte-8984204e-8f81-469e-b8d8-45b5f9b9241a" released by "delete_volume" :: held 0.608s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Created reservations ['da391403-2ccc-4806-963e-4e3e1f449303', '3724f099-91de-4a0c-b527-5ef286115d4f', '112a33d8-07f2-4406-a011-14881df78933', 'c86447e2-2e51-4020-bcab-1a2bb2349dcf'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:12 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:11:12 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:12 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.233s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:11:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Deleted volume successfully. Sep 02 00:11:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96009f75-72d2-48d3-afb7-9a5ed6fd159c tempest-TestImageHashVerification-1647453291 None] Lock "cinder-8984204e-8f81-469e-b8d8-45b5f9b9241a-delete_volume" released by "delete_volume" :: held 1.022s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:11:22 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:11:22 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Flow 'volume_create_manager' (8c26be13-2fc8-4be8-977e-825246542879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569c0560-4547-4b65-b2d8-13a46667adc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569c0560-4547-4b65-b2d8-13a46667adc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710412b-7529-4e54-b18b-020ff101ef60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e70500759754733a4f971250a53f747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:27Z,use_quota=True,user_id='a0c25891c7eb4f2cbebbe7a4c07328a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09021236-c7dd-47c2-93df-e5fb575df280),volume_type_id=09021236-c7dd-47c2-93df-e5fb575df280)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729ebb38-546d-453a-b123-fe72120f8b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729ebb38-546d-453a-b123-fe72120f8b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90a8cbd-1ba1-411f-a5f0-7e9607b015ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90a8cbd-1ba1-411f-a5f0-7e9607b015ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a710412b-7529-4e54-b18b-020ff101ef60', 'volume_name': 'volume-a710412b-7529-4e54-b18b-020ff101ef60', 'volume_size': 1, 'image_id': '9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db094b21fd155c15a7e519cfc4c5eb64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e70500759754733a4f971250a53f747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '382a8922e351e7a3a79b93860ef8e7c2a39041277c157f2b2187fbce6a41b33c1f3d198637228f5eb09b88979c30bafba89b14875444a363749af048887ad89c', 'id': '9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'created_at': datetime.datetime(2026, 9, 1, 22, 11, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 11, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c15b0da-aac9-45f0-ab94-15ca3717c8fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6ea913-c8c4-4b7b-a9f9-8f3dcf9aa800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6ea913-c8c4-4b7b-a9f9-8f3dcf9aa800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd6ed95-8350-4118-8d42-f1168fc3e22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Volume a710412b-7529-4e54-b18b-020ff101ef60: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a710412b-7529-4e54-b18b-020ff101ef60', 'volume_size': 1, 'image_id': '9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db094b21fd155c15a7e519cfc4c5eb64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e70500759754733a4f971250a53f747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '382a8922e351e7a3a79b93860ef8e7c2a39041277c157f2b2187fbce6a41b33c1f3d198637228f5eb09b88979c30bafba89b14875444a363749af048887ad89c', 'id': '9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'created_at': datetime.datetime(2026, 9, 1, 22, 11, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 11, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c15b0da-aac9-45f0-ab94-15ca3717c8fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 02 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Trying to clone a710412b-7529-4e54-b18b-020ff101ef60 from image 9c15b0da-aac9-45f0-ab94-15ca3717c8fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:11:27 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Image download 0.00 MB at 0.00 MB/s Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e1b33c-5164-49b1-a449-378490c76f64]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:27 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD Sep 02 00:11:27 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:27 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:27 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD Sep 02 00:11:27 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:27 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Temporary image 9c15b0da-aac9-45f0-ab94-15ca3717c8fc is fetched for user a0c25891c7eb4f2cbebbe7a4c07328a8. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b6de26-7163-4e8a-8918-8b27991f50ea]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:27 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD Sep 02 00:11:27 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:28 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:28 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD Sep 02 00:11:28 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:28 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD" returned: 1 in 0.307s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710412b-7529-4e54-b18b-020ff101ef60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e70500759754733a4f971250a53f747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:27Z,use_quota=True,user_id='a0c25891c7eb4f2cbebbe7a4c07328a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09021236-c7dd-47c2-93df-e5fb575df280),volume_type_id=09021236-c7dd-47c2-93df-e5fb575df280)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Creating volume a710412b-7529-4e54-b18b-020ff101ef60 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:11:28 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:28 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 1073741824 Sep 02 00:11:28 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:28 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 1073741824" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:28 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 Sep 02 00:11:28 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:29 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60" returned: 0 in 0.238s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Attempting download of 9c15b0da-aac9-45f0-ab94-15ca3717c8fc ((None, [{'url': 'file:///opt/stack/data/glance/images/9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'metadata': {}}])) to volume a710412b-7529-4e54-b18b-020ff101ef60. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a329ad6b-a58b-4f30-a871-b4adc0a53783]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_jo4f2qe2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:29 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_jo4f2qe2 Sep 02 00:11:29 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:29 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_jo4f2qe2" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_jo4f2qe2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:29 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_jo4f2qe2 Sep 02 00:11:29 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:29 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_jo4f2qe2" returned: 1 in 0.324s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_jo4f2qe2' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1eba80-c39c-4e50-8cca-d4134182fe62]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:29 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD Sep 02 00:11:29 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:30 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:30 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD Sep 02 00:11:30 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:30 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD" returned: 1 in 0.308s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:11:30 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] 9c15b0da-aac9-45f0-ab94-15ca3717c8fc was raw, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:11:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:30 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 Sep 02 00:11:30 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:30 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60" returned: 0 in 0.427s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:30 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c15b0da-aac9-45f0-ab94-15ca3717c8fc_96lae1yidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:11:30 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 00:11:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:30 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 1G Sep 02 00:11:30 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:31 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 1G" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Downloaded image 9c15b0da-aac9-45f0-ab94-15ca3717c8fc ((None, [{'url': 'file:///opt/stack/data/glance/images/9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'metadata': {}}])) to volume a710412b-7529-4e54-b18b-020ff101ef60 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Temporary image 9c15b0da-aac9-45f0-ab94-15ca3717c8fc for user a0c25891c7eb4f2cbebbe7a4c07328a8 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Marking volume a710412b-7529-4e54-b18b-020ff101ef60 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Copying metadata from image 9c15b0da-aac9-45f0-ab94-15ca3717c8fc to a710412b-7529-4e54-b18b-020ff101ef60. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Creating volume glance metadata for volume a710412b-7529-4e54-b18b-020ff101ef60 backed by image 9c15b0da-aac9-45f0-ab94-15ca3717c8fc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'db094b21fd155c15a7e519cfc4c5eb64', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd6ed95-8350-4118-8d42-f1168fc3e22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a710412b-7529-4e54-b18b-020ff101ef60', 'volume_size': 1, 'image_id': '9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db094b21fd155c15a7e519cfc4c5eb64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e70500759754733a4f971250a53f747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '382a8922e351e7a3a79b93860ef8e7c2a39041277c157f2b2187fbce6a41b33c1f3d198637228f5eb09b88979c30bafba89b14875444a363749af048887ad89c', 'id': '9c15b0da-aac9-45f0-ab94-15ca3717c8fc', 'created_at': datetime.datetime(2026, 9, 1, 22, 11, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 11, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c15b0da-aac9-45f0-ab94-15ca3717c8fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22fbc3e-fee1-48de-9d03-a6032cce9dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:31 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Volume volume-a710412b-7529-4e54-b18b-020ff101ef60 (a710412b-7529-4e54-b18b-020ff101ef60): created successfully Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22fbc3e-fee1-48de-9d03-a6032cce9dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Flow 'volume_create_manager' (8c26be13-2fc8-4be8-977e-825246542879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b8f19067-248d-4b39-b39e-4d67e66d5c2e tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Created volume successfully. Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Acquiring lock "cinder-a710412b-7529-4e54-b18b-020ff101ef60-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "cinder-a710412b-7529-4e54-b18b-020ff101ef60-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Acquiring lock "cinder-quobyte-a710412b-7529-4e54-b18b-020ff101ef60" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "cinder-quobyte-a710412b-7529-4e54-b18b-020ff101ef60" acquired by "delete_volume" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f376212-e1cc-4070-909d-0c2bc4fdd1e7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:32 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 Sep 02 00:11:32 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:32 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:32 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60 Sep 02 00:11:32 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:32 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a710412b-7529-4e54-b18b-020ff101ef60" returned: 0 in 0.235s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "cinder-quobyte-a710412b-7529-4e54-b18b-020ff101ef60" released by "delete_volume" :: held 0.612s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:11:32 devstack cinder-volume[86591]: WARNING cinder.quota [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:11:32 devstack cinder-volume[86591]: WARNING cinder.quota [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Created reservations ['ad6925e1-a6b0-48ef-8aae-28458e86b9f4', '25193b9a-350e-4a6a-8874-f0276b641076', '8e31174b-e6c5-4e61-ad42-6596b39a0fc2', '3039ddee-d33b-4eda-95a4-bbea656b14fd'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:32 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:11:32 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:32 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.232s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:11:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Deleted volume successfully. Sep 02 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eabd1ba5-f874-4a11-a843-08b6c0c37c11 tempest-VolumeAndVolumeTypeFromImageTest-966423547 None] Lock "cinder-a710412b-7529-4e54-b18b-020ff101ef60-delete_volume" released by "delete_volume" :: held 1.021s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:11:42 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:11:42 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:11:49 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (7dd933ab-c258-45b8-9cfc-f55dcfeba38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5033e9-05ab-4e48-8c06-d5c80a8c2726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5033e9-05ab-4e48-8c06-d5c80a8c2726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-12707018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d777672b-ad63-4efe-9b4f-2f2927cc24b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:50Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee4c935-848c-4189-b93a-9f9ef92aba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee4c935-848c-4189-b93a-9f9ef92aba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e57250-c9c1-4bbc-a826-7ba6f5e41ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e57250-c9c1-4bbc-a826-7ba6f5e41ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd777672b-ad63-4efe-9b4f-2f2927cc24b5', 'volume_name': 'volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93729fc-c7d7-47ce-a226-de152bd40ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93729fc-c7d7-47ce-a226-de152bd40ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78958082-6343-42cc-89bd-49075315b0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Volume d777672b-ad63-4efe-9b4f-2f2927cc24b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5', 'volume_size': 1} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-12707018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d777672b-ad63-4efe-9b4f-2f2927cc24b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:50Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Creating volume d777672b-ad63-4efe-9b4f-2f2927cc24b5 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:11:50 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:50 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 1073741824 Sep 02 00:11:50 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (2cec4cbf-2201-4850-aac9-3521eb2afe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2ad8e2-d300-4e56-9559-11a5c894cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2ad8e2-d300-4e56-9559-11a5c894cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835228725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4b3698-d746-4d44-8b0d-abb691433d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:50Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649c4345-8048-432a-ba61-6c86c58fb618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649c4345-8048-432a-ba61-6c86c58fb618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1216ca1-5258-4b09-9039-8c5bdda8d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1216ca1-5258-4b09-9039-8c5bdda8d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4b3698-d746-4d44-8b0d-abb691433d3d', 'volume_name': 'volume-cc4b3698-d746-4d44-8b0d-abb691433d3d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dea4d10-7f77-4761-91a1-ffa2a9ad813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dea4d10-7f77-4761-91a1-ffa2a9ad813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02748fa-2087-48fc-9538-d076e2585697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Volume cc4b3698-d746-4d44-8b0d-abb691433d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4b3698-d746-4d44-8b0d-abb691433d3d', 'volume_size': 1} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:50 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 1073741824" returned: 0 in 0.756s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (bde9612f-440d-4565-a5b9-712fd1ea7067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1b37bc-b4da-4da8-87f3-ac2b8c0ca069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1b37bc-b4da-4da8-87f3-ac2b8c0ca069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184723294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:51Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d88620-2692-46c2-aeea-26ea31dd87af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d88620-2692-46c2-aeea-26ea31dd87af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec43d2ee-8925-496a-ad74-3b3061c7cb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 Sep 02 00:11:51 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec43d2ee-8925-496a-ad74-3b3061c7cb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0', 'volume_name': 'volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761e0bb9-1982-41a8-866f-ad66d2a8d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761e0bb9-1982-41a8-866f-ad66d2a8d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f80d4d9-b1df-4242-80c2-8997a13aea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Volume 02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0', 'volume_size': 1} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (873180d1-3690-4722-9105-2f06202f4498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45619215-4b56-49ea-814c-39009614f5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45619215-4b56-49ea-814c-39009614f5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392011003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61044e91-3624-4e10-bfd4-46fefd4d25eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:51Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080113e2-00b1-45fe-b7fe-6ebcadbc5fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080113e2-00b1-45fe-b7fe-6ebcadbc5fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5acd55-fb99-4cd8-8480-cd91db31ff2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5acd55-fb99-4cd8-8480-cd91db31ff2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61044e91-3624-4e10-bfd4-46fefd4d25eb', 'volume_name': 'volume-61044e91-3624-4e10-bfd4-46fefd4d25eb', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0276c09-af15-40b4-80e3-bb113fdd7276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0276c09-af15-40b4-80e3-bb113fdd7276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9eb119-5c99-45f2-bd5b-91c5090a70f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Volume 61044e91-3624-4e10-bfd4-46fefd4d25eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61044e91-3624-4e10-bfd4-46fefd4d25eb', 'volume_size': 1} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:51 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5" returned: 0 in 0.582s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.957s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835228725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4b3698-d746-4d44-8b0d-abb691433d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:50Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Creating volume cc4b3698-d746-4d44-8b0d-abb691433d3d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:11:51 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78958082-6343-42cc-89bd-49075315b0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d 1073741824 Sep 02 00:11:51 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8924f4c2-4791-4279-a5dd-4e9b7a1eb949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Volume volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 (d777672b-ad63-4efe-9b4f-2f2927cc24b5): created successfully Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8924f4c2-4791-4279-a5dd-4e9b7a1eb949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (7dd933ab-c258-45b8-9cfc-f55dcfeba38d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-de1a6a06-82da-4eba-b134-3a22d8fbe4fe tempest-CreateVolumesFromImageTest-543965672 None] Created volume successfully. Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:11:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (76391baa-5266-41a7-8659-23ba693d5b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928a7b12-7aff-4990-b4f6-161c1c1dc939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928a7b12-7aff-4990-b4f6-161c1c1dc939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177111984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d83065-87de-4357-9525-23a58708c103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:52Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfaab20-c0e5-4613-8b33-576b55997ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfaab20-c0e5-4613-8b33-576b55997ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbf0bde-1b6f-4e0f-897a-c67071379b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbf0bde-1b6f-4e0f-897a-c67071379b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d83065-87de-4357-9525-23a58708c103', 'volume_name': 'volume-c1d83065-87de-4357-9525-23a58708c103', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0b4609-02bb-49c1-89fd-e8f01fda56a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0b4609-02bb-49c1-89fd-e8f01fda56a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08b900c-e0b4-41e6-9b56-5e07f25e3383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Volume c1d83065-87de-4357-9525-23a58708c103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d83065-87de-4357-9525-23a58708c103', 'volume_size': 1} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:52 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d 1073741824" returned: 0 in 0.589s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:52 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d Sep 02 00:11:52 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:52 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d" returned: 0 in 0.293s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184723294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:51Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Creating volume 02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:11:52 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:52 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 1073741824 Sep 02 00:11:52 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02748fa-2087-48fc-9538-d076e2585697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4b3698-d746-4d44-8b0d-abb691433d3d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f22f2f-fd1e-43a9-8bbf-7063760a005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Volume volume-cc4b3698-d746-4d44-8b0d-abb691433d3d (cc4b3698-d746-4d44-8b0d-abb691433d3d): created successfully Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f22f2f-fd1e-43a9-8bbf-7063760a005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (2cec4cbf-2201-4850-aac9-3521eb2afe4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-df7c0454-7d57-4146-984b-203df0adf7dd tempest-CreateVolumesFromImageTest-543965672 None] Created volume successfully. Sep 02 00:11:53 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 1073741824" returned: 0 in 0.546s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:53 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 Sep 02 00:11:53 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:53 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0" returned: 0 in 0.315s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.932s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392011003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61044e91-3624-4e10-bfd4-46fefd4d25eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:51Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Creating volume 61044e91-3624-4e10-bfd4-46fefd4d25eb {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:11:53 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:53 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb 1073741824 Sep 02 00:11:53 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f80d4d9-b1df-4242-80c2-8997a13aea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf534ac-5002-4ccb-9e52-12064d2c63da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Volume volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 (02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0): created successfully Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf534ac-5002-4ccb-9e52-12064d2c63da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (bde9612f-440d-4565-a5b9-712fd1ea7067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-06d752ea-e907-4969-8c55-6091ffc5a10d tempest-CreateVolumesFromImageTest-543965672 None] Created volume successfully. Sep 02 00:11:54 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb 1073741824" returned: 0 in 0.573s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:54 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb Sep 02 00:11:54 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:54 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb" returned: 0 in 0.430s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.489s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177111984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d83065-87de-4357-9525-23a58708c103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26c70e8bea04e62bde49125f5dadb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:52Z,use_quota=True,user_id='05adf081caba462da755b533717ca489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Creating volume c1d83065-87de-4357-9525-23a58708c103 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:11:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9eb119-5c99-45f2-bd5b-91c5090a70f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61044e91-3624-4e10-bfd4-46fefd4d25eb', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:54 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103 1073741824 Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43d13e6-b6b7-47b0-86a7-2cf75143ccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:54 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Volume volume-61044e91-3624-4e10-bfd4-46fefd4d25eb (61044e91-3624-4e10-bfd4-46fefd4d25eb): created successfully Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43d13e6-b6b7-47b0-86a7-2cf75143ccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (873180d1-3690-4722-9105-2f06202f4498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-eaa95e54-5b5c-43a7-8db1-fd3133d44355 tempest-CreateVolumesFromImageTest-543965672 None] Created volume successfully. Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Flow 'volume_create_manager' (cc2513b7-7fe4-4db4-83c6-2e63691f09e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc273611-d88f-4821-be2d-149db723a3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc273611-d88f-4821-be2d-149db723a3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b2e048-ab28-4d67-86c3-9bb48c1954d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db58c6ad79a84926bd0cc6042ed5532a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:55Z,use_quota=True,user_id='56c76bd1abcf420491f4dd1273c30269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f796ab6b-9f67-446a-8db1-7b4386bf3a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f796ab6b-9f67-446a-8db1-7b4386bf3a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c700e21-8927-45aa-ad15-86cb40cd08f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:54 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:11:55 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103 1073741824" returned: 0 in 0.612s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:55 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103 Sep 02 00:11:55 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c700e21-8927-45aa-ad15-86cb40cd08f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4b2e048-ab28-4d67-86c3-9bb48c1954d5', 'volume_name': 'volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5', 'volume_size': 1, 'image_id': 'bcf84439-266e-420c-b229-19f1b62c87be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcf84439-266e-420c-b229-19f1b62c87be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccad73b69daee6a3e4004949aa943705', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db58c6ad79a84926bd0cc6042ed5532a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24301e705c3f100b507b2a8a11514b786da30e7c80824ff0a066601d95d77f40be71c3e43c302ed9696308751a9ac0844ea9eeed6dc09e8d9c6a9099ba2e9686', 'id': 'bcf84439-266e-420c-b229-19f1b62c87be', 'created_at': datetime.datetime(2026, 9, 1, 22, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcf84439-266e-420c-b229-19f1b62c87be/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a1fd1d-cc2c-4f7e-a288-a2ce620d2b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a1fd1d-cc2c-4f7e-a288-a2ce620d2b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed362f72-7b49-4c20-89bf-d23c7d6125e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Volume a4b2e048-ab28-4d67-86c3-9bb48c1954d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5', 'volume_size': 1, 'image_id': 'bcf84439-266e-420c-b229-19f1b62c87be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcf84439-266e-420c-b229-19f1b62c87be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccad73b69daee6a3e4004949aa943705', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db58c6ad79a84926bd0cc6042ed5532a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24301e705c3f100b507b2a8a11514b786da30e7c80824ff0a066601d95d77f40be71c3e43c302ed9696308751a9ac0844ea9eeed6dc09e8d9c6a9099ba2e9686', 'id': 'bcf84439-266e-420c-b229-19f1b62c87be', 'created_at': datetime.datetime(2026, 9, 1, 22, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcf84439-266e-420c-b229-19f1b62c87be/file', 'properties': {}}, 'image_service': } Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Trying to clone a4b2e048-ab28-4d67-86c3-9bb48c1954d5 from image bcf84439-266e-420c-b229-19f1b62c87be at location (None, [{'url': 'file:///opt/stack/data/glance/images/bcf84439-266e-420c-b229-19f1b62c87be', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:11:55 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Image download 0.00 MB at 0.00 MB/s Sep 02 00:11:55 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08b900c-e0b4-41e6-9b56-5e07f25e3383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d83065-87de-4357-9525-23a58708c103', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57a0d64-3ee4-4b78-960c-cf44f6c32777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7124e42e-422e-41ea-8575-dcb892fa80ec]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Volume volume-c1d83065-87de-4357-9525-23a58708c103 (c1d83065-87de-4357-9525-23a58708c103): created successfully Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57a0d64-3ee4-4b78-960c-cf44f6c32777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Flow 'volume_create_manager' (76391baa-5266-41a7-8659-23ba693d5b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2539909d-b434-4f59-a93a-c7f754aa9fb8 tempest-CreateVolumesFromImageTest-543965672 None] Created volume successfully. Sep 02 00:11:55 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD Sep 02 00:11:55 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:56 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Flow 'volume_create_manager' (0414fe4e-82f6-42b6-b8a3-51ff85e69418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766b09cc-ddae-4554-aa15-280b3982c89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:56 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD Sep 02 00:11:56 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766b09cc-ddae-4554-aa15-280b3982c89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719eef30-b755-42bd-8eb7-94c5b6bdc021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd23667b4874f8b9be172aacfc157e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:56Z,use_quota=True,user_id='0c09ff78150043aa9336ccf901beb542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2cde18b-9427-4838-803c-f66033028f58),volume_type_id=b2cde18b-9427-4838-803c-f66033028f58)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1635287f-7af7-4a00-9573-61f6a71576e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1635287f-7af7-4a00-9573-61f6a71576e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da164a3f-6dbb-43f5-8264-5c4909cd27a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:11:56 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Temporary image bcf84439-266e-420c-b229-19f1b62c87be is fetched for user 56c76bd1abcf420491f4dd1273c30269. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f3453c-f2ad-411d-8a6c-8115b8d6da38]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da164a3f-6dbb-43f5-8264-5c4909cd27a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '719eef30-b755-42bd-8eb7-94c5b6bdc021', 'volume_name': 'volume-719eef30-b755-42bd-8eb7-94c5b6bdc021', 'volume_size': 1, 'image_id': 'bc4ee0d8-fc56-4669-9047-3f25a329e903', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc4ee0d8-fc56-4669-9047-3f25a329e903', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '113527a3c64d772bc312f8185089618d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'edd23667b4874f8b9be172aacfc157e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e66ac1910d7c272bc6f1f56dafb15fa804fc2e414c1f88b8b546fbe4fc3980878798d3556947408487925cb24d44183f17de8399f0ec18c835772dda8c01200d', 'id': 'bc4ee0d8-fc56-4669-9047-3f25a329e903', 'created_at': datetime.datetime(2026, 9, 1, 22, 11, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 11, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc4ee0d8-fc56-4669-9047-3f25a329e903/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702ae305-5e41-4604-9dd9-51368814c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702ae305-5e41-4604-9dd9-51368814c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd61386-1f0a-4a0f-a401-c04a47e12760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Volume 719eef30-b755-42bd-8eb7-94c5b6bdc021: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-719eef30-b755-42bd-8eb7-94c5b6bdc021', 'volume_size': 1, 'image_id': 'bc4ee0d8-fc56-4669-9047-3f25a329e903', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc4ee0d8-fc56-4669-9047-3f25a329e903', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '113527a3c64d772bc312f8185089618d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'edd23667b4874f8b9be172aacfc157e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e66ac1910d7c272bc6f1f56dafb15fa804fc2e414c1f88b8b546fbe4fc3980878798d3556947408487925cb24d44183f17de8399f0ec18c835772dda8c01200d', 'id': 'bc4ee0d8-fc56-4669-9047-3f25a329e903', 'created_at': datetime.datetime(2026, 9, 1, 22, 11, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 11, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc4ee0d8-fc56-4669-9047-3f25a329e903/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Trying to clone 719eef30-b755-42bd-8eb7-94c5b6bdc021 from image bc4ee0d8-fc56-4669-9047-3f25a329e903 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bc4ee0d8-fc56-4669-9047-3f25a329e903', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:11:56 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD Sep 02 00:11:56 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:11:56 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Image download 0.00 MB at 0.00 MB/s Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-c1d83065-87de-4357-9525-23a58708c103-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bb8e11-bbdd-44a4-a3bf-4cbccd39a324]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-c1d83065-87de-4357-9525-23a58708c103-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-quobyte-c1d83065-87de-4357-9525-23a58708c103" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:11:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-c1d83065-87de-4357-9525-23a58708c103" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:11:56 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD Sep 02 00:11:56 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:56 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c62e4a6-b0a6-4644-a3ba-a88b74ffd00e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:57 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD Sep 02 00:11:57 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:57 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103 Sep 02 00:11:57 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:57 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:57 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD" returned: 1 in 0.376s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b2e048-ab28-4d67-86c3-9bb48c1954d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db58c6ad79a84926bd0cc6042ed5532a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:55Z,use_quota=True,user_id='56c76bd1abcf420491f4dd1273c30269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Creating volume a4b2e048-ab28-4d67-86c3-9bb48c1954d5 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:57 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD Sep 02 00:11:57 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:11:57 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:57 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 1073741824 Sep 02 00:11:57 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:57 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103" returned: 0 in 0.448s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:57 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103 Sep 02 00:11:57 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:57 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD" returned: 1 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Temporary image bc4ee0d8-fc56-4669-9047-3f25a329e903 is fetched for user 0c09ff78150043aa9336ccf901beb542. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:11:57 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c1d83065-87de-4357-9525-23a58708c103" returned: 0 in 0.369s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-c1d83065-87de-4357-9525-23a58708c103" released by "delete_volume" :: held 0.876s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3facf340-6eb3-459d-bb3e-c0d2da062cdc]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Created reservations ['b587a7b6-ed1a-4480-b479-bb8f2b56725e', 'ec76e37f-6083-4c17-9773-7d7868b0ff84', 'fefdbda5-8b61-4b33-a308-3f97513ae871', '56e57a22-e63a-47fd-aa6e-f7aa3898fd28'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:11:57 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD Sep 02 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (77ac3eb9-1d1d-4a96-a7b7-7973d47e7439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:57 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da914f87-fbfa-4432-907d-80fa1e8a47c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:58 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 1073741824" returned: 0 in 0.625s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da914f87-fbfa-4432-907d-80fa1e8a47c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081273191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0bae31-d39b-49f4-8e7b-e23682f67098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:58Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805afabe-2536-46b5-8883-816658d09c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805afabe-2536-46b5-8883-816658d09c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee3c0fa-3c75-47b7-9b59-827b6058a1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee3c0fa-3c75-47b7-9b59-827b6058a1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0bae31-d39b-49f4-8e7b-e23682f67098', 'volume_name': 'volume-cd0bae31-d39b-49f4-8e7b-e23682f67098', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7046a90-71c0-446f-8291-d1feccc1310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7046a90-71c0-446f-8291-d1feccc1310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc683cb-ed18-4b64-941b-997db5b329ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Volume cd0bae31-d39b-49f4-8e7b-e23682f67098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0bae31-d39b-49f4-8e7b-e23682f67098', 'volume_size': 1} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:58 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:11:58 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:58 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:58 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 Sep 02 00:11:58 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:58 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD Sep 02 00:11:58 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:58 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.259s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:11:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Deleted volume successfully. Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-215862ed-838f-43ba-bd94-4ab593d1368f tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-c1d83065-87de-4357-9525-23a58708c103-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:11:58 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081273191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0bae31-d39b-49f4-8e7b-e23682f67098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:58Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Creating volume cd0bae31-d39b-49f4-8e7b-e23682f67098 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:11:58 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:58 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 1073741824 Sep 02 00:11:58 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Attempting download of bcf84439-266e-420c-b229-19f1b62c87be ((None, [{'url': 'file:///opt/stack/data/glance/images/bcf84439-266e-420c-b229-19f1b62c87be', 'metadata': {}}])) to volume a4b2e048-ab28-4d67-86c3-9bb48c1954d5. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:11:58 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[571670f7-457d-4c0a-b3eb-4d790df5bda8]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcf84439-266e-420c-b229-19f1b62c87be_z4p3v9sj {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:58 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcf84439-266e-420c-b229-19f1b62c87be_z4p3v9sj Sep 02 00:11:58 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:58 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcf84439-266e-420c-b229-19f1b62c87be_z4p3v9sj" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcf84439-266e-420c-b229-19f1b62c87be_z4p3v9sj {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:58 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 1073741824" returned: 0 in 0.486s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:59 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-61044e91-3624-4e10-bfd4-46fefd4d25eb-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:11:59 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:59 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcf84439-266e-420c-b229-19f1b62c87be_z4p3v9sj Sep 02 00:11:59 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-61044e91-3624-4e10-bfd4-46fefd4d25eb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-quobyte-61044e91-3624-4e10-bfd4-46fefd4d25eb" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-61044e91-3624-4e10-bfd4-46fefd4d25eb" acquired by "delete_volume" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5356843a-4b64-42c9-9938-bf627350921e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:59 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb Sep 02 00:11:59 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:59 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcf84439-266e-420c-b229-19f1b62c87be_z4p3v9sj" returned: 1 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcf84439-266e-420c-b229-19f1b62c87be_z4p3v9sj' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b698762d-05c7-42b7-b0b2-a3d4567cde9b]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:59 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719eef30-b755-42bd-8eb7-94c5b6bdc021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd23667b4874f8b9be172aacfc157e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:11:56Z,use_quota=True,user_id='0c09ff78150043aa9336ccf901beb542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2cde18b-9427-4838-803c-f66033028f58),volume_type_id=b2cde18b-9427-4838-803c-f66033028f58)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Creating volume 719eef30-b755-42bd-8eb7-94c5b6bdc021 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:11:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc683cb-ed18-4b64-941b-997db5b329ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0bae31-d39b-49f4-8e7b-e23682f67098', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f74d5a5-395e-427e-820c-1571aca4eaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:11:59 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 1073741824 Sep 02 00:11:59 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:59 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD Sep 02 00:11:59 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Volume volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 (cd0bae31-d39b-49f4-8e7b-e23682f67098): created successfully Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f74d5a5-395e-427e-820c-1571aca4eaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (77ac3eb9-1d1d-4a96-a7b7-7973d47e7439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:11:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-076b66bd-756e-438b-8429-0bc5ac87d7df tempest-ProjectMemberTests-204781831 None] Created volume successfully. Sep 02 00:11:59 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:59 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb Sep 02 00:11:59 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:59 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:59 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD Sep 02 00:11:59 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:59 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 1073741824" returned: 0 in 0.457s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:11:59 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-61044e91-3624-4e10-bfd4-46fefd4d25eb" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:11:59 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 Sep 02 00:11:59 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:11:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-61044e91-3624-4e10-bfd4-46fefd4d25eb" released by "delete_volume" :: held 0.811s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Created reservations ['099b1bb4-a8f5-494d-9461-7f1edaf1c85e', '436073c6-0249-4a22-bb41-18c2534b4a97', 'a112fcc5-0db7-4de3-a5c2-abe2f718e883', '7f91146e-8a98-4295-bb3b-7c9eab6a672e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:00 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD" returned: 1 in 0.407s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] bcf84439-266e-420c-b229-19f1b62c87be was raw, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:00 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 Sep 02 00:12:00 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:00 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:00 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:00 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Attempting download of bc4ee0d8-fc56-4669-9047-3f25a329e903 ((None, [{'url': 'file:///opt/stack/data/glance/images/bc4ee0d8-fc56-4669-9047-3f25a329e903', 'metadata': {}}])) to volume 719eef30-b755-42bd-8eb7-94c5b6bdc021. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d174194-367f-46b8-bef6-26869a64405a]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc4ee0d8-fc56-4669-9047-3f25a329e903_5szh_coo {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Creating offline snapshot d618ab25-5170-4b9b-8af3-796d40521a60 of volume cd0bae31-d39b-49f4-8e7b-e23682f67098 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-quobyte-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59158b8-672d-433d-9ee5-7cb841e62b04]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc987dd-0c2b-47c5-92bd-4844a8319ddb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:00 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.420s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Deleted volume successfully. Sep 02 00:12:00 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc4ee0d8-fc56-4669-9047-3f25a329e903_5szh_coo Sep 02 00:12:00 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-100171bf-408b-4cf8-b196-926754a61e9f tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-61044e91-3624-4e10-bfd4-46fefd4d25eb-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:00 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 Sep 02 00:12:00 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:00 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 Sep 02 00:12:00 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:00 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5" returned: 0 in 0.682s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bcf84439-266e-420c-b229-19f1b62c87be_m6qcbl50devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:12:00 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:00 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 1G Sep 02 00:12:00 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:00 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc4ee0d8-fc56-4669-9047-3f25a329e903_5szh_coo" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc4ee0d8-fc56-4669-9047-3f25a329e903_5szh_coo {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:00 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:00 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 1G Sep 02 00:12:00 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:01 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc4ee0d8-fc56-4669-9047-3f25a329e903_5szh_coo Sep 02 00:12:01 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:01 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0" returned: 0 in 0.452s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:01 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0 Sep 02 00:12:01 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:01 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 1G" returned: 0 in 0.436s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Downloaded image bcf84439-266e-420c-b229-19f1b62c87be ((None, [{'url': 'file:///opt/stack/data/glance/images/bcf84439-266e-420c-b229-19f1b62c87be', 'metadata': {}}])) to volume a4b2e048-ab28-4d67-86c3-9bb48c1954d5 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Temporary image bcf84439-266e-420c-b229-19f1b62c87be for user 56c76bd1abcf420491f4dd1273c30269 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Marking volume a4b2e048-ab28-4d67-86c3-9bb48c1954d5 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Copying metadata from image bcf84439-266e-420c-b229-19f1b62c87be to a4b2e048-ab28-4d67-86c3-9bb48c1954d5. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Creating volume glance metadata for volume a4b2e048-ab28-4d67-86c3-9bb48c1954d5 backed by image bcf84439-266e-420c-b229-19f1b62c87be with: {'image_id': 'bcf84439-266e-420c-b229-19f1b62c87be', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ccad73b69daee6a3e4004949aa943705', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:12:01 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc4ee0d8-fc56-4669-9047-3f25a329e903_5szh_coo" returned: 1 in 0.439s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc4ee0d8-fc56-4669-9047-3f25a329e903_5szh_coo' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[66311bb8-3bbd-45d7-8540-2b365aad53aa]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:01 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0" returned: 0 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0" released by "delete_volume" :: held 0.837s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed362f72-7b49-4c20-89bf-d23c7d6125e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5', 'volume_size': 1, 'image_id': 'bcf84439-266e-420c-b229-19f1b62c87be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcf84439-266e-420c-b229-19f1b62c87be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccad73b69daee6a3e4004949aa943705', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db58c6ad79a84926bd0cc6042ed5532a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24301e705c3f100b507b2a8a11514b786da30e7c80824ff0a066601d95d77f40be71c3e43c302ed9696308751a9ac0844ea9eeed6dc09e8d9c6a9099ba2e9686', 'id': 'bcf84439-266e-420c-b229-19f1b62c87be', 'created_at': datetime.datetime(2026, 9, 1, 22, 11, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcf84439-266e-420c-b229-19f1b62c87be/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602ea27b-ed5e-4180-b4a6-fc6b290e2261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Volume volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 (a4b2e048-ab28-4d67-86c3-9bb48c1954d5): created successfully Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602ea27b-ed5e-4180-b4a6-fc6b290e2261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Flow 'volume_create_manager' (cc2513b7-7fe4-4db4-83c6-2e63691f09e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f8041448-5caf-4443-879e-825512aeb1e6 tempest-VolumeImageDependencyTests-1050544813 None] Created volume successfully. Sep 02 00:12:01 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD Sep 02 00:12:01 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Created reservations ['b9f95775-1ba9-449a-9ce5-2a763ccd72d8', '72b072d4-9e74-482a-aa15-1029e2303b37', '864d511d-7ed0-4330-81fa-b2f0aa25e92b', '3af7ad51-9d37-47ea-ac67-253f6d6608c9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:01 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 1G" returned: 0 in 0.605s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:01 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 Sep 02 00:12:01 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:01 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:01 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:01 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:01 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD Sep 02 00:12:01 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:01 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60" returned: 0 in 0.312s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:01 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 is being set with open permissions: ugo+rw Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:01 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 Sep 02 00:12:01 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:01 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:01 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Deleted volume successfully. Sep 02 00:12:02 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] bc4ee0d8-fc56-4669-9047-3f25a329e903 was raw, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:02 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 Sep 02 00:12:02 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-736e6f28-ec77-4ece-8db0-5203e52ba68d tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-02a9c8a9-92b9-4f63-b72d-6effc5ac8ed0-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:02 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60" returned: 0 in 0.281s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:02 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.info Sep 02 00:12:02 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Acquiring lock "cinder-a4b2e048-ab28-4d67-86c3-9bb48c1954d5-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Lock "cinder-a4b2e048-ab28-4d67-86c3-9bb48c1954d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Acquiring lock "cinder-quobyte-a4b2e048-ab28-4d67-86c3-9bb48c1954d5" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Lock "cinder-quobyte-a4b2e048-ab28-4d67-86c3-9bb48c1954d5" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[082c7dde-4c79-40cb-8c18-05f821c7331e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:02 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.info" returned: 0 in 0.341s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:02 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.info is being set with open permissions: ugo+rw Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:02 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.info Sep 02 00:12:02 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:02 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 Sep 02 00:12:02 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-cc4b3698-d746-4d44-8b0d-abb691433d3d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-cc4b3698-d746-4d44-8b0d-abb691433d3d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:02 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021" returned: 0 in 0.647s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bc4ee0d8-fc56-4669-9047-3f25a329e903_ejstvymtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:12:02 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:02 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 1G Sep 02 00:12:02 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-quobyte-cc4b3698-d746-4d44-8b0d-abb691433d3d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-cc4b3698-d746-4d44-8b0d-abb691433d3d" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb51be70-fca7-4e24-ab78-56de599b568e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:02 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.info" returned: 0 in 0.348s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.456s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:02 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d Sep 02 00:12:02 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:02 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-121c0405-2cdf-4fef-b440-593ac9f1a10d tempest-ProjectMemberTests-204781831 None] Create snapshot completed successfully Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5" returned: 0 in 0.503s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:02 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5 Sep 02 00:12:02 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:03 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 1G" returned: 0 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Downloaded image bc4ee0d8-fc56-4669-9047-3f25a329e903 ((None, [{'url': 'file:///opt/stack/data/glance/images/bc4ee0d8-fc56-4669-9047-3f25a329e903', 'metadata': {}}])) to volume 719eef30-b755-42bd-8eb7-94c5b6bdc021 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Temporary image bc4ee0d8-fc56-4669-9047-3f25a329e903 for user 0c09ff78150043aa9336ccf901beb542 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Marking volume 719eef30-b755-42bd-8eb7-94c5b6bdc021 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Copying metadata from image bc4ee0d8-fc56-4669-9047-3f25a329e903 to 719eef30-b755-42bd-8eb7-94c5b6bdc021. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Creating volume glance metadata for volume 719eef30-b755-42bd-8eb7-94c5b6bdc021 backed by image bc4ee0d8-fc56-4669-9047-3f25a329e903 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bc4ee0d8-fc56-4669-9047-3f25a329e903', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '113527a3c64d772bc312f8185089618d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd61386-1f0a-4a0f-a401-c04a47e12760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719eef30-b755-42bd-8eb7-94c5b6bdc021', 'volume_size': 1, 'image_id': 'bc4ee0d8-fc56-4669-9047-3f25a329e903', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc4ee0d8-fc56-4669-9047-3f25a329e903', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '113527a3c64d772bc312f8185089618d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'edd23667b4874f8b9be172aacfc157e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e66ac1910d7c272bc6f1f56dafb15fa804fc2e414c1f88b8b546fbe4fc3980878798d3556947408487925cb24d44183f17de8399f0ec18c835772dda8c01200d', 'id': 'bc4ee0d8-fc56-4669-9047-3f25a329e903', 'created_at': datetime.datetime(2026, 9, 1, 22, 11, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 11, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc4ee0d8-fc56-4669-9047-3f25a329e903/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c0d0ea-c446-4573-b502-51aa355c6224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Volume volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 (719eef30-b755-42bd-8eb7-94c5b6bdc021): created successfully Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c0d0ea-c446-4573-b502-51aa355c6224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Flow 'volume_create_manager' (0414fe4e-82f6-42b6-b8a3-51ff85e69418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-86d00fe6-2da8-437f-994f-32c4f338f872 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Created volume successfully. Sep 02 00:12:03 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:03 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:03 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d Sep 02 00:12:03 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a4b2e048-ab28-4d67-86c3-9bb48c1954d5" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Lock "cinder-quobyte-a4b2e048-ab28-4d67-86c3-9bb48c1954d5" released by "delete_volume" :: held 0.866s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Created reservations ['ed5519a2-5e2d-4cd9-ace2-39424794be0e', 'b79c5b2e-40e0-4fbb-bb99-b011ed201b8d', '8b582680-838c-463c-813b-941f6700c721', '350dfa80-ef11-4517-8282-1e7daecace6b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:03 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:03 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:03 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cc4b3698-d746-4d44-8b0d-abb691433d3d" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-cc4b3698-d746-4d44-8b0d-abb691433d3d" released by "delete_volume" :: held 0.795s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-d618ab25-5170-4b9b-8af3-796d40521a60-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Created reservations ['2a17c7d8-8453-4931-afa3-4afbc071f915', '69a54e18-b4dc-4217-95bb-b86c1f7c0511', '9a2574db-25be-4ab5-9b8d-650353736eed', 'b5811c39-0a87-479b-92f1-564b6ee2a67a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Lock "cinder-d618ab25-5170-4b9b-8af3-796d40521a60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-cd0bae31-d39b-49f4-8e7b-e23682f67098" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-cd0bae31-d39b-49f4-8e7b-e23682f67098" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-d618ab25-5170-4b9b-8af3-796d40521a60" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:03 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-d618ab25-5170-4b9b-8af3-796d40521a60" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Deleting offline snapshot d618ab25-5170-4b9b-8af3-796d40521a60 of volume cd0bae31-d39b-49f4-8e7b-e23682f67098 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] snapshot_file for this snap is: volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.414s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5490bc33-d898-4f50-8317-d85969701657]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Deleted volume successfully. Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-d777672b-ad63-4efe-9b4f-2f2927cc24b5-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Acquiring lock "cinder-719eef30-b755-42bd-8eb7-94c5b6bdc021-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c15975c2-7cb0-498a-965d-dfcb6a6414c9 tempest-VolumeImageDependencyTests-1050544813 None] Lock "cinder-a4b2e048-ab28-4d67-86c3-9bb48c1954d5-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-d777672b-ad63-4efe-9b4f-2f2927cc24b5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "cinder-719eef30-b755-42bd-8eb7-94c5b6bdc021-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:03 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:03 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "cinder-quobyte-d777672b-ad63-4efe-9b4f-2f2927cc24b5" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Acquiring lock "cinder-quobyte-719eef30-b755-42bd-8eb7-94c5b6bdc021" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:04 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 Sep 02 00:12:04 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-d777672b-ad63-4efe-9b4f-2f2927cc24b5" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "cinder-quobyte-719eef30-b755-42bd-8eb7-94c5b6bdc021" acquired by "delete_volume" :: waited 0.058s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[474d9061-241f-44da-a889-b4d242654f7f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbd8eaf-238e-403f-be8c-2d20998739ba]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:04 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 Sep 02 00:12:04 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:04 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 Sep 02 00:12:04 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:04 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Deleted volume successfully. Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22838975-313e-45f2-a699-387f687fc724 tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-cc4b3698-d746-4d44-8b0d-abb691433d3d-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:04 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60" returned: 0 in 0.637s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd0bae31-d39b-49f4-8e7b-e23682f67098(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05d4f30-58a5-4fd4-a1c1-b825d7b82316]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:04 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:04 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021 Sep 02 00:12:04 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:04 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5" returned: 0 in 0.567s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:04 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 Sep 02 00:12:04 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:04 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5 Sep 02 00:12:04 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:04 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-719eef30-b755-42bd-8eb7-94c5b6bdc021" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:05 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "cinder-quobyte-719eef30-b755-42bd-8eb7-94c5b6bdc021" released by "delete_volume" :: held 0.923s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:05 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d777672b-ad63-4efe-9b4f-2f2927cc24b5" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098" returned: 0 in 0.524s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-quobyte-d777672b-ad63-4efe-9b4f-2f2927cc24b5" released by "delete_volume" :: held 1.001s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:05 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 Sep 02 00:12:05 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Created reservations ['892dc46a-edde-48c1-b58e-a38bd104eb8f', '5b06b696-52fb-43e7-a7e1-183f613e5c41', 'a2e20da1-6eee-49fe-8899-c9911be014d5', '46b3c97a-b5f6-48ef-9b23-7879e8fc6dba'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Created reservations ['4bbee578-82ee-4e20-81b8-f64aff7101bd', '2aba2c0f-50ff-4199-82b0-06aa6a4b59e1', '4b2a1b65-0bdb-45f3-8adc-25dee9cd7228', '4476a84b-6ce8-4588-a5c1-36225481288d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:05 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:05 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:05 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:05 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:05 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60" returned: 0 in 0.469s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:05 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Deleted volume successfully. Sep 02 00:12:05 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60 Sep 02 00:12:05 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e9f7c18e-94a6-4561-a590-eabb3584cdf2 tempest-VolumeAndVolumeTypeFromImageTest-1593934894 None] Lock "cinder-719eef30-b755-42bd-8eb7-94c5b6bdc021-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:05 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Deleted volume successfully. Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8b47853-b58c-4fdd-b243-5b2bf5459639 tempest-CreateVolumesFromImageTest-543965672 None] Lock "cinder-d777672b-ad63-4efe-9b4f-2f2927cc24b5-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:05 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098.d618ab25-5170-4b9b-8af3-796d40521a60" returned: 0 in 0.301s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-d618ab25-5170-4b9b-8af3-796d40521a60" released by "_delete_snapshot" :: held 2.093s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-cd0bae31-d39b-49f4-8e7b-e23682f67098" released by "delete_snapshot" :: held 2.144s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Created reservations ['6c6e1922-339b-44a5-b38a-66cacbcf65ec', 'd9da8751-1769-4965-9f15-8eb5ca02eefa', '586b1ddc-763d-4215-ae1d-1347b6cc372c', '6c78c45a-c879-4706-85a7-5f3243dd5817'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Delete snapshot completed successfully. Sep 02 00:12:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a5dc99b2-6b04-4016-8417-a2b7a11640d2 tempest-ProjectMemberTests-204781831 None] Lock "cinder-d618ab25-5170-4b9b-8af3-796d40521a60-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:06 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:06 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:06 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 28 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-cd0bae31-d39b-49f4-8e7b-e23682f67098-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Lock "cinder-cd0bae31-d39b-49f4-8e7b-e23682f67098-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-cd0bae31-d39b-49f4-8e7b-e23682f67098" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-cd0bae31-d39b-49f4-8e7b-e23682f67098" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[477abc47-56dd-45f1-b7f3-60d45a60f94e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:07 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 Sep 02 00:12:07 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:07 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098" returned: 0 in 0.544s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:07 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098 Sep 02 00:12:07 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:07 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd0bae31-d39b-49f4-8e7b-e23682f67098" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-cd0bae31-d39b-49f4-8e7b-e23682f67098" released by "delete_volume" :: held 0.974s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Created reservations ['83f3e5e2-5955-455e-a228-578b77aa3a95', '93d4e481-8a9a-4782-8e42-24f88a286e1d', '263fd8a6-61ed-428a-874d-6472eff0f7bb', '24bf1ac1-000b-45a0-aca3-574ce40b5077'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:08 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:08 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Flow 'volume_create_manager' (31dea669-3267-4bd1-b1e4-0191a9be25e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619c399a-0f5e-40f2-a3cc-3bc3fe419afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619c399a-0f5e-40f2-a3cc-3bc3fe419afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ff1531-9a8d-455e-8eec-4959f20554d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244b3fae5d8d448eb0a0efd1544af26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:08Z,use_quota=True,user_id='3e2170f21668469bb1632bb76ddf7f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8144ce-2ccf-4e23-87b6-09357b9ded73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8144ce-2ccf-4e23-87b6-09357b9ded73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9e0c22-c362-4e13-9849-4be582550e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:08 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9e0c22-c362-4e13-9849-4be582550e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ff1531-9a8d-455e-8eec-4959f20554d1', 'volume_name': 'volume-c6ff1531-9a8d-455e-8eec-4959f20554d1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7785e148-69fb-467e-be79-55196fcf2568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7785e148-69fb-467e-be79-55196fcf2568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb7482b-2f9d-4870-9951-28873c5573a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Volume c6ff1531-9a8d-455e-8eec-4959f20554d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ff1531-9a8d-455e-8eec-4959f20554d1', 'volume_size': 1} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ff1531-9a8d-455e-8eec-4959f20554d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244b3fae5d8d448eb0a0efd1544af26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:08Z,use_quota=True,user_id='3e2170f21668469bb1632bb76ddf7f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Creating volume c6ff1531-9a8d-455e-8eec-4959f20554d1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:08 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Deleted volume successfully. Sep 02 00:12:08 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 1073741824 Sep 02 00:12:08 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d50473f0-d59b-4cf1-ad37-7271768574ce tempest-ProjectMemberTests-204781831 None] Lock "cinder-cd0bae31-d39b-49f4-8e7b-e23682f67098-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:09 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 1073741824" returned: 0 in 0.565s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:09 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 Sep 02 00:12:09 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:09 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb7482b-2f9d-4870-9951-28873c5573a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ff1531-9a8d-455e-8eec-4959f20554d1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9152a7bc-5345-4f78-835e-7f8187d3db75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Volume volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 (c6ff1531-9a8d-455e-8eec-4959f20554d1): created successfully Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9152a7bc-5345-4f78-835e-7f8187d3db75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Flow 'volume_create_manager' (31dea669-3267-4bd1-b1e4-0191a9be25e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-31d7279d-3e89-438d-983a-177ee5235417 tempest-CinderUnicodeTest-1049210875 None] Created volume successfully. Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (030cb2df-e8bb-4c05-ba08-f054bba611ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e1a72a-80a8-467a-b70d-455756aa7280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e1a72a-80a8-467a-b70d-455756aa7280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096668665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee8fb20-d791-4f0d-8471-66e2628b3445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:10Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab52ce8-b150-43f8-9ec8-e72b40b2e451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab52ce8-b150-43f8-9ec8-e72b40b2e451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f35d55-4673-4697-8863-5b6a57739989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f35d55-4673-4697-8863-5b6a57739989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee8fb20-d791-4f0d-8471-66e2628b3445', 'volume_name': 'volume-aee8fb20-d791-4f0d-8471-66e2628b3445', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7304c1-e54c-48f9-b08b-2f6a688f7ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7304c1-e54c-48f9-b08b-2f6a688f7ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7d5cf5-c05c-4240-8fc9-938061e1a910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Volume aee8fb20-d791-4f0d-8471-66e2628b3445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee8fb20-d791-4f0d-8471-66e2628b3445', 'volume_size': 1} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096668665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee8fb20-d791-4f0d-8471-66e2628b3445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:10Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Creating volume aee8fb20-d791-4f0d-8471-66e2628b3445 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:10 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:10 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 1073741824 Sep 02 00:12:10 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (c6d37245-3601-4004-b0a9-f1a76e058029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:10 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3022d03-ad68-4ecd-8a54-4e250b0bff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 1073741824" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3022d03-ad68-4ecd-8a54-4e250b0bff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-488705914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c119cf-64c8-4336-aa71-f87d96bf020b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:10Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be6ebf2-87d5-4697-9d91-9f26246ce55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be6ebf2-87d5-4697-9d91-9f26246ce55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad6102f-c1da-4941-9910-8279d3a6af54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad6102f-c1da-4941-9910-8279d3a6af54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c119cf-64c8-4336-aa71-f87d96bf020b', 'volume_name': 'volume-28c119cf-64c8-4336-aa71-f87d96bf020b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c9dcc4-4fbf-4c5e-9c17-67930c1d39ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c9dcc4-4fbf-4c5e-9c17-67930c1d39ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b525d6d-f3cb-42d6-95c7-5fa6eab06f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume 28c119cf-64c8-4336-aa71-f87d96bf020b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c119cf-64c8-4336-aa71-f87d96bf020b', 'volume_size': 1} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:10 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 Sep 02 00:12:10 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:10 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-488705914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c119cf-64c8-4336-aa71-f87d96bf020b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:10Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Creating volume 28c119cf-64c8-4336-aa71-f87d96bf020b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:10 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7d5cf5-c05c-4240-8fc9-938061e1a910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee8fb20-d791-4f0d-8471-66e2628b3445', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362bf8d6-dee4-4c74-95e7-ecac4e070fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:10 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b 1073741824 Sep 02 00:12:10 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Volume volume-aee8fb20-d791-4f0d-8471-66e2628b3445 (aee8fb20-d791-4f0d-8471-66e2628b3445): created successfully Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362bf8d6-dee4-4c74-95e7-ecac4e070fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (030cb2df-e8bb-4c05-ba08-f054bba611ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-768a012b-4ea0-40ba-b8de-00e5f3ca2cfd tempest-ProjectMemberTests-204781831 None] Created volume successfully. Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Flow 'volume_create_manager' (7e60e586-2a1c-4fcc-ba9f-d65a92df9e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5567a59c-9e6c-44d1-b8c4-6f0c1b4662b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5567a59c-9e6c-44d1-b8c4-6f0c1b4662b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-862449544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46265a6a-ee5e-4aaa-bbb1-464456f0564a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244b3fae5d8d448eb0a0efd1544af26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:11Z,use_quota=True,user_id='3e2170f21668469bb1632bb76ddf7f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a1ca9e-ab45-484f-b8af-a7a6073c4f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a1ca9e-ab45-484f-b8af-a7a6073c4f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc2cb36-146b-4f72-b913-e2dd23cfbabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc2cb36-146b-4f72-b913-e2dd23cfbabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46265a6a-ee5e-4aaa-bbb1-464456f0564a', 'volume_name': 'volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ea9fc8-0cf8-4b86-b63b-b3d8229a4bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ea9fc8-0cf8-4b86-b63b-b3d8229a4bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4bbc0c-94cb-4cc7-be45-03ab198d40c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Volume 46265a6a-ee5e-4aaa-bbb1-464456f0564a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a', 'volume_size': 1} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:11 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b 1073741824" returned: 0 in 0.509s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:11 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b Sep 02 00:12:11 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:11 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b" returned: 0 in 0.253s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-862449544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46265a6a-ee5e-4aaa-bbb1-464456f0564a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244b3fae5d8d448eb0a0efd1544af26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:11Z,use_quota=True,user_id='3e2170f21668469bb1632bb76ddf7f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Creating volume 46265a6a-ee5e-4aaa-bbb1-464456f0564a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:11 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b525d6d-f3cb-42d6-95c7-5fa6eab06f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c119cf-64c8-4336-aa71-f87d96bf020b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:11 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a 1073741824 Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a86721-a0cf-4a3d-9b68-851a0de1cd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:11 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume volume-28c119cf-64c8-4336-aa71-f87d96bf020b (28c119cf-64c8-4336-aa71-f87d96bf020b): created successfully Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a86721-a0cf-4a3d-9b68-851a0de1cd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (c6d37245-3601-4004-b0a9-f1a76e058029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-78827639-8029-44bd-9b39-c587c3ea4607 tempest-CreateVolumesFromSnapshotTest-77644943 None] Created volume successfully. Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Flow 'volume_create_manager' (cedef9f5-d093-4d22-899c-51340b0e7a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7105b134-2559-4b30-8d5e-cfa4204d4c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7105b134-2559-4b30-8d5e-cfa4204d4c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-36473556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0233d1-069e-4354-adc9-ad4332df6200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae904f874fd24c66b9caab5bec732d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:12Z,use_quota=True,user_id='17ec561a7ffd45c983daff3bf849def4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f3d20b-797e-467f-a297-f7738eca43b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f3d20b-797e-467f-a297-f7738eca43b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:12 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e901510b-9287-4429-a35b-f2fcfd0383b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e901510b-9287-4429-a35b-f2fcfd0383b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad0233d1-069e-4354-adc9-ad4332df6200', 'volume_name': 'volume-ad0233d1-069e-4354-adc9-ad4332df6200', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b016857e-362a-4e09-9be2-49c9e9b4a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b016857e-362a-4e09-9be2-49c9e9b4a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643fa2fc-a825-4744-9753-b29ebc836e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Volume ad0233d1-069e-4354-adc9-ad4332df6200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad0233d1-069e-4354-adc9-ad4332df6200', 'volume_size': 1} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a 1073741824" returned: 0 in 0.582s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:12 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a Sep 02 00:12:12 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:12 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-36473556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0233d1-069e-4354-adc9-ad4332df6200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae904f874fd24c66b9caab5bec732d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:12Z,use_quota=True,user_id='17ec561a7ffd45c983daff3bf849def4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Creating volume ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:12 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4bbc0c-94cb-4cc7-be45-03ab198d40c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:12 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 1073741824 Sep 02 00:12:12 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbeda7f-d415-48b5-ba54-8f5c4939ac97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Volume volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a (46265a6a-ee5e-4aaa-bbb1-464456f0564a): created successfully Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbeda7f-d415-48b5-ba54-8f5c4939ac97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Flow 'volume_create_manager' (7e60e586-2a1c-4fcc-ba9f-d65a92df9e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-966bd46e-ea98-4be0-a77b-04249308b202 tempest-CinderUnicodeTest-1049210875 None] Created volume successfully. Sep 02 00:12:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:13 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 1073741824" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:13 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 Sep 02 00:12:13 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:13 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643fa2fc-a825-4744-9753-b29ebc836e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad0233d1-069e-4354-adc9-ad4332df6200', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465bdec2-965d-4401-adfe-085a20df1721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Creating offline snapshot ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b of volume aee8fb20-d791-4f0d-8471-66e2628b3445 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:13 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Volume volume-ad0233d1-069e-4354-adc9-ad4332df6200 (ad0233d1-069e-4354-adc9-ad4332df6200): created successfully Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465bdec2-965d-4401-adfe-085a20df1721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Flow 'volume_create_manager' (cedef9f5-d093-4d22-899c-51340b0e7a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d011f7-bbad-42f0-8244-5ad190377055]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e8a22156-d453-4165-a1ab-7008a3e0ba1c tempest-VolumeDependencyTests-890930905 None] Created volume successfully. Sep 02 00:12:13 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 Sep 02 00:12:13 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:13 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445" returned: 0 in 0.379s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:13 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b 1G Sep 02 00:12:13 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:14 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b 1G" returned: 0 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aee8fb20-d791-4f0d-8471-66e2628b3445 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:14 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aee8fb20-d791-4f0d-8471-66e2628b3445 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b Sep 02 00:12:14 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:14 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aee8fb20-d791-4f0d-8471-66e2628b3445 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b" returned: 0 in 0.327s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:14 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b is being set with open permissions: ugo+rw Sep 02 00:12:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:14 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b Sep 02 00:12:14 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:14 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b" returned: 0 in 0.239s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:14 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.info Sep 02 00:12:14 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:14 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.info" returned: 0 in 0.240s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:15 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.info is being set with open permissions: ugo+rw Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:15 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.info Sep 02 00:12:15 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:15 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.info" returned: 0 in 0.238s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.477s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Creating offline snapshot 0b3933e8-95c6-4e07-9afa-0379275fb0e1 of volume 28c119cf-64c8-4336-aa71-f87d96bf020b {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-34d90ca3-49ca-4cd5-ab32-82841874203f tempest-ProjectMemberTests-204781831 None] Create snapshot completed successfully Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2910e5b7-17a5-493f-b856-12c94f162dba]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Lock "cinder-ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:15 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b Sep 02 00:12:15 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-aee8fb20-d791-4f0d-8471-66e2628b3445" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-aee8fb20-d791-4f0d-8471-66e2628b3445" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Deleting offline snapshot ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b of volume aee8fb20-d791-4f0d-8471-66e2628b3445 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] snapshot_file for this snap is: volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec42084e-c142-479a-bda7-07cd80fd75eb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:15 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b Sep 02 00:12:15 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:15 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b" returned: 0 in 0.399s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:15 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 1G Sep 02 00:12:15 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:15 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b" returned: 0 in 0.375s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aee8fb20-d791-4f0d-8471-66e2628b3445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fe5e33-c2b7-4ef8-8182-7a7a06257bb9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:16 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 Sep 02 00:12:16 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:16 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 1G" returned: 0 in 0.418s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c119cf-64c8-4336-aa71-f87d96bf020b -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:16 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c119cf-64c8-4336-aa71-f87d96bf020b -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 Sep 02 00:12:16 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:16 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:16 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b Sep 02 00:12:16 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:16 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c119cf-64c8-4336-aa71-f87d96bf020b -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1" returned: 0 in 0.287s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:16 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 is being set with open permissions: ugo+rw Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:16 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 Sep 02 00:12:16 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:16 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:16 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b Sep 02 00:12:16 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:16 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1" returned: 0 in 0.280s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:16 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.info Sep 02 00:12:16 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:16 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445.ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b" returned: 0 in 0.248s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b" released by "_delete_snapshot" :: held 1.462s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-aee8fb20-d791-4f0d-8471-66e2628b3445" released by "delete_snapshot" :: held 1.489s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:16 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.info" returned: 0 in 0.246s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:16 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.info is being set with open permissions: ugo+rw Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:16 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.info Sep 02 00:12:16 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Created reservations ['45400ba6-1f14-4c5a-8691-7c25e76ce96c', '5e2877c8-4f89-422c-9621-ca9b5522c97c', 'e453fc58-c56c-4333-9dd3-195c61a8e951', '203e724e-f707-46c2-b583-ce808055ef0f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Delete snapshot completed successfully. Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-80ac0f2f-9103-4345-bcff-949de997ba49 tempest-ProjectMemberTests-204781831 None] Lock "cinder-ef27e0b1-797f-42be-a8af-8f8fc4a3bf8b-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:17 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.info" returned: 0 in 0.242s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.619s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Creating offline snapshot fa2bb7c1-c519-4150-809a-a871c703d9e2 of volume 46265a6a-ee5e-4aaa-bbb1-464456f0564a {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-988ed962-56d9-42f9-8fcd-82b63ce79c31 tempest-CreateVolumesFromSnapshotTest-77644943 None] Create snapshot completed successfully Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0918e0-43fc-47ed-ba7e-2ed8eb164f1f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:17 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a Sep 02 00:12:17 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:17 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-aee8fb20-d791-4f0d-8471-66e2628b3445-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a" returned: 0 in 0.374s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Lock "cinder-aee8fb20-d791-4f0d-8471-66e2628b3445-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:17 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 1G Sep 02 00:12:17 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-aee8fb20-d791-4f0d-8471-66e2628b3445" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-aee8fb20-d791-4f0d-8471-66e2628b3445" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae2997-3f0c-4135-8b5a-a08cbd0ba5ea]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:17 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 Sep 02 00:12:17 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:18 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 1G" returned: 0 in 0.433s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:18 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 Sep 02 00:12:18 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:18 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445" returned: 0 in 0.394s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:18 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445 Sep 02 00:12:18 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:18 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2" returned: 0 in 0.347s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:18 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 is being set with open permissions: ugo+rw Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:18 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-aee8fb20-d791-4f0d-8471-66e2628b3445" returned: 0 in 0.301s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:18 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 Sep 02 00:12:18 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-aee8fb20-d791-4f0d-8471-66e2628b3445" released by "delete_volume" :: held 0.779s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (3e0ad9fb-5586-4cc5-bba2-8e06b11c97ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdfd3de-e84f-4279-b1f1-9f4d332c5d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdfd3de-e84f-4279-b1f1-9f4d332c5d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132893418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64c0815-f93e-4f77-8756-317463f402ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:18Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115a0fc6-f0e5-4f5a-99ff-51dd578ecfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115a0fc6-f0e5-4f5a-99ff-51dd578ecfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f3113b-1ade-4766-b414-3942f6c604ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f3113b-1ade-4766-b414-3942f6c604ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e64c0815-f93e-4f77-8756-317463f402ca', 'volume_name': 'volume-e64c0815-f93e-4f77-8756-317463f402ca', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8282a432-d8e1-451b-a38b-44644f47dee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8282a432-d8e1-451b-a38b-44644f47dee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e20c6b-50a4-4189-8c78-d9b665d8f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume e64c0815-f93e-4f77-8756-317463f402ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e64c0815-f93e-4f77-8756-317463f402ca', 'volume_size': 1} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Created reservations ['10a61f48-1630-4412-99b8-38f8be039de3', '551cc0c1-176a-438a-b156-51c29c241d8a', '7c805cbd-0be6-4598-8e84-c3d7f7e25d8e', 'c2e84ecc-39f3-40b0-9cbe-46637a4d5d9a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:18 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2" returned: 0 in 0.329s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:18 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:18 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:18 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.info Sep 02 00:12:18 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (77ed1bdc-9499-4102-b5b1-5736a22e6700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39e905c-1279-4b58-bb39-6c59a8019b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39e905c-1279-4b58-bb39-6c59a8019b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1658689335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eda16fc-95ce-4ad4-bb97-efb7e6a2152e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:19Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09059b09-d2f7-4e6e-8859-8b5744e4edb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09059b09-d2f7-4e6e-8859-8b5744e4edb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c917c6eb-c722-40f4-9a04-7ca7302a7d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c917c6eb-c722-40f4-9a04-7ca7302a7d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eda16fc-95ce-4ad4-bb97-efb7e6a2152e', 'volume_name': 'volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c749448-1667-4cf5-9257-cc65b6c8af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c749448-1667-4cf5-9257-cc65b6c8af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f296383-df93-44e8-907f-9f468f61d6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume 3eda16fc-95ce-4ad4-bb97-efb7e6a2152e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e', 'volume_size': 1} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:19 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Deleted volume successfully. Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1f452c04-a8ab-4454-89f6-d1a0da00d13a tempest-ProjectMemberTests-204781831 None] Lock "cinder-aee8fb20-d791-4f0d-8471-66e2628b3445-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:19 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.info" returned: 0 in 0.430s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:19 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.info is being set with open permissions: ugo+rw Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:19 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.info Sep 02 00:12:19 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:19 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.info" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.159s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (c0f31c9b-aacf-42de-8e9a-e57ea2b55d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1d19a4-e10c-4dac-a84a-c6aefe3a11d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Creating offline snapshot 81b6d696-cbea-4671-b4b9-69fb11f2f03e of volume ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f1bcadd4-52ba-491c-a6e8-dedeaaad2b46 tempest-CinderUnicodeTest-1049210875 None] Create snapshot completed successfully Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1d19a4-e10c-4dac-a84a-c6aefe3a11d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1717081201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b753fbc9-df80-4196-ae99-6b7875ad911a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:19Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be33f9a9-5c6b-4289-8c8e-a953e89b465b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be33f9a9-5c6b-4289-8c8e-a953e89b465b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f0339b-e40c-4ff9-9100-a51b780ce919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f0339b-e40c-4ff9-9100-a51b780ce919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b753fbc9-df80-4196-ae99-6b7875ad911a', 'volume_name': 'volume-b753fbc9-df80-4196-ae99-6b7875ad911a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194dca90-f29c-4058-a78f-45edb847fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194dca90-f29c-4058-a78f-45edb847fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4adff23-cb77-404d-ba52-9c64ba89f668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume b753fbc9-df80-4196-ae99-6b7875ad911a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b753fbc9-df80-4196-ae99-6b7875ad911a', 'volume_size': 1} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[af686391-9358-4c04-9345-e379da898f77]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:19 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 Sep 02 00:12:19 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (f814a5c1-5e74-45d5-b436-386a04f3ff2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3a8a2e-3ede-481e-ad4d-6f5937a70787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "cinder-fa2bb7c1-c519-4150-809a-a871c703d9e2-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3a8a2e-3ede-481e-ad4d-6f5937a70787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577954866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cc75db-aa76-4593-870b-629ea6aa0750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:20Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c049f0-583c-4ecd-aad2-0cd4278530fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c049f0-583c-4ecd-aad2-0cd4278530fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1034741-c8cd-4222-859a-cfd63dd6570b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1034741-c8cd-4222-859a-cfd63dd6570b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6cc75db-aa76-4593-870b-629ea6aa0750', 'volume_name': 'volume-a6cc75db-aa76-4593-870b-629ea6aa0750', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3007ae-bd62-4a4d-b913-3c486685aa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3007ae-bd62-4a4d-b913-3c486685aa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9ad910-bfea-4d67-b0a2-517ab1dc8a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Volume a6cc75db-aa76-4593-870b-629ea6aa0750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6cc75db-aa76-4593-870b-629ea6aa0750', 'volume_size': 1} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-fa2bb7c1-c519-4150-809a-a871c703d9e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.128s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "cinder-quobyte-46265a6a-ee5e-4aaa-bbb1-464456f0564a" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (7ba4ed3e-5514-454f-b708-e1d606be0073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88afa430-c64f-4429-8d54-5b8ab6595024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-quobyte-46265a6a-ee5e-4aaa-bbb1-464456f0564a" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "cinder-quobyte-fa2bb7c1-c519-4150-809a-a871c703d9e2" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88afa430-c64f-4429-8d54-5b8ab6595024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108222915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2348f2a3-9108-4992-8c10-15ced4107923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:20Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1062b9f0-2038-4fb0-b791-56054d39e0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1062b9f0-2038-4fb0-b791-56054d39e0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1008e28-d86c-4c68-8cfa-006287a6e11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1008e28-d86c-4c68-8cfa-006287a6e11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2348f2a3-9108-4992-8c10-15ced4107923', 'volume_name': 'volume-2348f2a3-9108-4992-8c10-15ced4107923', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0726cf55-da49-4251-aafc-e86d3d43a98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0726cf55-da49-4251-aafc-e86d3d43a98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a547f64b-71b8-4ed8-88c9-f33e17752fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume 2348f2a3-9108-4992-8c10-15ced4107923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2348f2a3-9108-4992-8c10-15ced4107923', 'volume_size': 1} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-quobyte-fa2bb7c1-c519-4150-809a-a871c703d9e2" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Deleting offline snapshot fa2bb7c1-c519-4150-809a-a871c703d9e2 of volume 46265a6a-ee5e-4aaa-bbb1-464456f0564a {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] snapshot_file for this snap is: volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[202df089-730b-4971-bdee-d0f6585d35f6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:20 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200" returned: 0 in 0.562s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:20 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e 1G Sep 02 00:12:20 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (2b07e1ff-8648-4d05-a681-85f672c795b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c61e7e7-1ea8-4e35-b7fb-238695dd12ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c61e7e7-1ea8-4e35-b7fb-238695dd12ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700787067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d99db7-c097-474d-890a-66cd09746855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:20Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84332e95-eb3e-4249-9634-ec1b4f8ca782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84332e95-eb3e-4249-9634-ec1b4f8ca782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fe1ec5-0e31-4f4f-ade9-a71f007b1562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fe1ec5-0e31-4f4f-ade9-a71f007b1562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d99db7-c097-474d-890a-66cd09746855', 'volume_name': 'volume-a8d99db7-c097-474d-890a-66cd09746855', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94afde3f-03e2-49d6-8d10-7be2c7070ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94afde3f-03e2-49d6-8d10-7be2c7070ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03a9073-fd36-4f7b-9978-b9ab8e0af2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume a8d99db7-c097-474d-890a-66cd09746855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d99db7-c097-474d-890a-66cd09746855', 'volume_size': 1} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:20 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 Sep 02 00:12:20 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:20 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:20 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e 1G" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad0233d1-069e-4354-adc9-ad4332df6200 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7251f32b-15ec-4f96-8dfd-0a711e6938f0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:20 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad0233d1-069e-4354-adc9-ad4332df6200 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e Sep 02 00:12:20 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:20 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a Sep 02 00:12:20 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:21 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad0233d1-069e-4354-adc9-ad4332df6200 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e" returned: 0 in 0.279s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:21 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e is being set with open permissions: ugo+rw Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:21 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e Sep 02 00:12:21 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:21 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a" returned: 0 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:21 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 Sep 02 00:12:21 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:21 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e" returned: 0 in 0.261s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:21 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.info Sep 02 00:12:21 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:21 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2" returned: 0 in 0.358s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:21 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2 Sep 02 00:12:21 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:21 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.info" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:21 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.info is being set with open permissions: ugo+rw Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:21 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.info Sep 02 00:12:21 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:21 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a.fa2bb7c1-c519-4150-809a-a871c703d9e2" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-quobyte-fa2bb7c1-c519-4150-809a-a871c703d9e2" released by "_delete_snapshot" :: held 1.534s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-quobyte-46265a6a-ee5e-4aaa-bbb1-464456f0564a" released by "delete_snapshot" :: held 1.620s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:21 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.info" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.207s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132893418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64c0815-f93e-4f77-8756-317463f402ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:18Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Creating volume e64c0815-f93e-4f77-8756-317463f402ca {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:21 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:21 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca 1073741824 Sep 02 00:12:21 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Created reservations ['730af85b-bd7a-4e4e-94f9-e6cea9b640ed', '715dfe01-7aa2-49cd-8fe3-99e230239ac2', 'b9e214d1-fd5f-4bc4-8946-a7b10565dc36', 'bbfc175b-6ddd-4657-9e82-7aec217acc09'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-abd20001-c329-49b6-a363-2ca4fc874384 tempest-VolumeDependencyTests-890930905 None] Create snapshot completed successfully Sep 02 00:12:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Delete snapshot completed successfully. Sep 02 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-aa6fbbee-91eb-4cd3-a012-66af215a4d74 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-fa2bb7c1-c519-4150-809a-a871c703d9e2-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "cinder-46265a6a-ee5e-4aaa-bbb1-464456f0564a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-46265a6a-ee5e-4aaa-bbb1-464456f0564a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "cinder-quobyte-46265a6a-ee5e-4aaa-bbb1-464456f0564a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-quobyte-46265a6a-ee5e-4aaa-bbb1-464456f0564a" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[165577f4-62e5-40a8-bb8b-3fa18a277055]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:22 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca 1073741824" returned: 0 in 0.477s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:22 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a Sep 02 00:12:22 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:22 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca Sep 02 00:12:22 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:22 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca" returned: 0 in 0.249s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.551s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1658689335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eda16fc-95ce-4ad4-bb97-efb7e6a2152e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:19Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Creating volume 3eda16fc-95ce-4ad4-bb97-efb7e6a2152e {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:22 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:22 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:22 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e 1073741824 Sep 02 00:12:22 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e20c6b-50a4-4189-8c78-d9b665d8f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e64c0815-f93e-4f77-8756-317463f402ca', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:22 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a Sep 02 00:12:22 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975c9122-809c-408b-aaf7-ec4e1022ec81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:22 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume volume-e64c0815-f93e-4f77-8756-317463f402ca (e64c0815-f93e-4f77-8756-317463f402ca): created successfully Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975c9122-809c-408b-aaf7-ec4e1022ec81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (3e0ad9fb-5586-4cc5-bba2-8e06b11c97ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-654dbee7-59b3-4133-8ec2-cb4dd6bdc6fb tempest-CreateVolumesFromSnapshotTest-77644943 None] Created volume successfully. Sep 02 00:12:22 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-46265a6a-ee5e-4aaa-bbb1-464456f0564a" returned: 0 in 0.264s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-quobyte-46265a6a-ee5e-4aaa-bbb1-464456f0564a" released by "delete_volume" :: held 0.711s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Created reservations ['61105afa-9273-4b1b-b1f6-53aba7dbcac4', 'a3ab266b-43e2-492a-8120-198d989c75a2', 'e696016f-52e0-43b7-a849-9a9a60e9ec22', '3d53b81b-e4b9-4936-9854-5ab61adf5525'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:23 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:23 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:23 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e 1073741824" returned: 0 in 0.517s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:23 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e Sep 02 00:12:23 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "cinder-c6ff1531-9a8d-455e-8eec-4959f20554d1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:23 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.377s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Deleted volume successfully. Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-c6ff1531-9a8d-455e-8eec-4959f20554d1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Flow 'volume_create_manager' (78a1c1b7-1e95-4909-9f10-ba554e351837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2107af69-cfe0-4979-9e47-36a745387200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:23 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2107af69-cfe0-4979-9e47-36a745387200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1019195828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639b0c31-ed13-44a3-b7ec-edac77673cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae904f874fd24c66b9caab5bec732d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81b6d696-cbea-4671-b4b9-69fb11f2f03e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:23Z,use_quota=True,user_id='17ec561a7ffd45c983daff3bf849def4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76b3cc3-8d33-4a44-9bf1-d20af7054bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76b3cc3-8d33-4a44-9bf1-d20af7054bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bcbc72-dded-4794-b6e6-7a6274cec9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bcbc72-dded-4794-b6e6-7a6274cec9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '639b0c31-ed13-44a3-b7ec-edac77673cd2', 'volume_name': 'volume-639b0c31-ed13-44a3-b7ec-edac77673cd2', 'volume_size': 1, 'snapshot_id': '81b6d696-cbea-4671-b4b9-69fb11f2f03e'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fcfde63-e24e-4e63-b921-2977cdd14157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fcfde63-e24e-4e63-b921-2977cdd14157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b531d58-3b39-4a19-866e-5230cee23d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Volume 639b0c31-ed13-44a3-b7ec-edac77673cd2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-639b0c31-ed13-44a3-b7ec-edac77673cd2', 'volume_size': 1, 'snapshot_id': '81b6d696-cbea-4671-b4b9-69fb11f2f03e'} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c970d37-9aa9-4a3a-8e2c-adaaa6a08c5f tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-46265a6a-ee5e-4aaa-bbb1-464456f0564a-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.853s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1717081201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b753fbc9-df80-4196-ae99-6b7875ad911a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:19Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Creating volume b753fbc9-df80-4196-ae99-6b7875ad911a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:23 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:23 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a 1073741824 Sep 02 00:12:23 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f296383-df93-44e8-907f-9f468f61d6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d50562-d56d-47ff-bd01-53e895f1dd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "cinder-quobyte-c6ff1531-9a8d-455e-8eec-4959f20554d1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e (3eda16fc-95ce-4ad4-bb97-efb7e6a2152e): created successfully Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d50562-d56d-47ff-bd01-53e895f1dd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (77ed1bdc-9499-4102-b5b1-5736a22e6700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-quobyte-c6ff1531-9a8d-455e-8eec-4959f20554d1" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4e41cb98-482b-48cf-bbad-91f27ada1487 tempest-CreateVolumesFromSnapshotTest-77644943 None] Created volume successfully. Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb5945-e6cb-45c4-929e-246086e0c6bd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:23 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 Sep 02 00:12:23 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:24 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a 1073741824" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:24 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1" returned: 0 in 0.371s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:24 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a Sep 02 00:12:24 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:24 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1 Sep 02 00:12:24 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:24 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a" returned: 0 in 0.258s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.234s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577954866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cc75db-aa76-4593-870b-629ea6aa0750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:20Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Creating volume a6cc75db-aa76-4593-870b-629ea6aa0750 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:24 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:24 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c6ff1531-9a8d-455e-8eec-4959f20554d1" returned: 0 in 0.271s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:24 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 1073741824 Sep 02 00:12:24 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4adff23-cb77-404d-ba52-9c64ba89f668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b753fbc9-df80-4196-ae99-6b7875ad911a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a305d1f0-7342-45d7-89f9-bb9d3f7af03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-quobyte-c6ff1531-9a8d-455e-8eec-4959f20554d1" released by "delete_volume" :: held 0.707s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume volume-b753fbc9-df80-4196-ae99-6b7875ad911a (b753fbc9-df80-4196-ae99-6b7875ad911a): created successfully Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a305d1f0-7342-45d7-89f9-bb9d3f7af03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (c0f31c9b-aacf-42de-8e9a-e57ea2b55d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0c544faa-feb0-4836-82bc-6cc8bfe0689b tempest-CreateVolumesFromSnapshotTest-77644943 None] Created volume successfully. Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Created reservations ['4309e4c9-672b-4fab-835b-904dd456acad', '2b1a51a2-6062-45f0-9ff2-df88ee07037e', '8a073b80-76f1-4a9f-85ba-6d4eaf776ad0', 'f8b0bed2-95f2-471b-a82b-4ea7c7f40e0c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:24 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:24 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:24 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 1073741824" returned: 0 in 0.460s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:24 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 Sep 02 00:12:24 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:24 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Deleted volume successfully. Sep 02 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b7c6cbe2-6e40-4e1a-8248-f64f8e4b4d05 tempest-CinderUnicodeTest-1049210875 None] Lock "cinder-c6ff1531-9a8d-455e-8eec-4959f20554d1-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:25 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750" returned: 0 in 0.259s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.866s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108222915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2348f2a3-9108-4992-8c10-15ced4107923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:20Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Creating volume 2348f2a3-9108-4992-8c10-15ced4107923 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:25 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9ad910-bfea-4d67-b0a2-517ab1dc8a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6cc75db-aa76-4593-870b-629ea6aa0750', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:25 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923 1073741824 Sep 02 00:12:25 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efea19b-2c90-46d6-9335-f765c537ac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:25 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Volume volume-a6cc75db-aa76-4593-870b-629ea6aa0750 (a6cc75db-aa76-4593-870b-629ea6aa0750): created successfully Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efea19b-2c90-46d6-9335-f765c537ac05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (f814a5c1-5e74-45d5-b436-386a04f3ff2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fee68d6a-9111-4b00-98f8-a0d4b389163b tempest-ProjectMemberTests-204781831 None] Created volume successfully. Sep 02 00:12:25 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923 1073741824" returned: 0 in 0.511s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:25 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923 Sep 02 00:12:25 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:25 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.545s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700787067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d99db7-c097-474d-890a-66cd09746855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf8ed25668d4c608171f1b6ffc83927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:20Z,use_quota=True,user_id='ce77029e51d247a5b6ba7746a086df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Creating volume a8d99db7-c097-474d-890a-66cd09746855 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:26 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:26 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855 1073741824 Sep 02 00:12:26 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a547f64b-71b8-4ed8-88c9-f33e17752fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2348f2a3-9108-4992-8c10-15ced4107923', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c2fc83-a983-4508-9e28-a1b69bd7083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume volume-2348f2a3-9108-4992-8c10-15ced4107923 (2348f2a3-9108-4992-8c10-15ced4107923): created successfully Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c2fc83-a983-4508-9e28-a1b69bd7083e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (7ba4ed3e-5514-454f-b708-e1d606be0073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ea83c724-6168-458d-93d8-ca4ed92db710 tempest-CreateVolumesFromSnapshotTest-77644943 None] Created volume successfully. Sep 02 00:12:26 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855 1073741824" returned: 0 in 0.457s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:26 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855 Sep 02 00:12:26 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:26 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855" returned: 0 in 0.252s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.104s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Acquiring lock "cinder-quobyte-81b6d696-cbea-4671-b4b9-69fb11f2f03e-639b0c31-ed13-44a3-b7ec-edac77673cd2" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03a9073-fd36-4f7b-9978-b9ab8e0af2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d99db7-c097-474d-890a-66cd09746855', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0388ba-9f8f-41d5-bbba-1589cc466b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-81b6d696-cbea-4671-b4b9-69fb11f2f03e-639b0c31-ed13-44a3-b7ec-edac77673cd2" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Creating volume 639b0c31-ed13-44a3-b7ec-edac77673cd2 from snapshot 81b6d696-cbea-4671-b4b9-69fb11f2f03e {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Acquiring lock "cinder-quobyte-639b0c31-ed13-44a3-b7ec-edac77673cd2" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Volume volume-a8d99db7-c097-474d-890a-66cd09746855 (a8d99db7-c097-474d-890a-66cd09746855): created successfully Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0388ba-9f8f-41d5-bbba-1589cc466b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Flow 'volume_create_manager' (2b07e1ff-8648-4d05-a681-85f672c795b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-639b0c31-ed13-44a3-b7ec-edac77673cd2" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] snapshot: 81b6d696-cbea-4671-b4b9-69fb11f2f03e, volume: 639b0c31-ed13-44a3-b7ec-edac77673cd2, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:12:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-11d28aa1-007b-47e1-acce-8961127f6053 tempest-CreateVolumesFromSnapshotTest-77644943 None] Created volume successfully. Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedbb01e-1181-43d7-a62d-81fbcb9d44b5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-a8d99db7-c097-474d-890a-66cd09746855-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-a8d99db7-c097-474d-890a-66cd09746855-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-quobyte-a8d99db7-c097-474d-890a-66cd09746855" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-a8d99db7-c097-474d-890a-66cd09746855" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:27 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e Sep 02 00:12:27 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f59486-df84-4498-81f3-9ddf5fde9a94]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:27 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855 Sep 02 00:12:27 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:27 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e" returned: 0 in 0.434s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad0233d1-069e-4354-adc9-ad4332df6200(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[781501d5-1250-43b4-b77b-5a41b98ff562]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:27 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:27 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 Sep 02 00:12:27 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:27 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855 Sep 02 00:12:27 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:27 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a8d99db7-c097-474d-890a-66cd09746855" returned: 0 in 0.275s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-a8d99db7-c097-474d-890a-66cd09746855" released by "delete_volume" :: held 0.724s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:27 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200" returned: 0 in 0.423s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:27 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 Sep 02 00:12:27 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Created reservations ['6177ee0c-a668-49c2-9dd4-e549d1813453', 'a5369b2b-95a0-44c5-bca7-314df1a772b9', '666179ca-455b-4018-b08b-3bb82da17837', '337754c3-c7f8-4616-93ab-ae244b228cac'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:27 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:27 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:28 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.266s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Deleted volume successfully. Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-2348f2a3-9108-4992-8c10-15ced4107923-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-2348f2a3-9108-4992-8c10-15ced4107923-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6653f2c-b281-4afb-a2f5-7bec16f2f28d tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-a8d99db7-c097-474d-890a-66cd09746855-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-quobyte-2348f2a3-9108-4992-8c10-15ced4107923" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-2348f2a3-9108-4992-8c10-15ced4107923" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31bd2a1-740f-41a6-a878-124e2a04f7bc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-75cc1604-cb3a-4d58-a429-b0b996f9a498 tempest-ProjectAdminTests-1376522751 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8815231323242, 'free_capacity_gb': 1773.8815231323242, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 00:12:28 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923 Sep 02 00:12:28 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:29 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923" returned: 0 in 0.847s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:29 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923 Sep 02 00:12:29 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:29 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-2348f2a3-9108-4992-8c10-15ced4107923" returned: 0 in 0.816s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-2348f2a3-9108-4992-8c10-15ced4107923" released by "delete_volume" :: held 1.735s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Created reservations ['ff5eae5d-c2f8-4ec9-8f60-35a00839f8dc', '9560fde1-2de7-4bb7-ac3a-45544bb32d95', '5bba0789-f0d1-4129-a79b-1175220675c7', '7013efc8-a81b-4b47-a50f-b0494fb6ed33'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:30 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:30 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-b753fbc9-df80-4196-ae99-6b7875ad911a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-b753fbc9-df80-4196-ae99-6b7875ad911a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-quobyte-b753fbc9-df80-4196-ae99-6b7875ad911a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-b753fbc9-df80-4196-ae99-6b7875ad911a" acquired by "delete_volume" :: waited 0.093s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd1f0e-517e-4ec6-a54b-466dc3df61b0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:31 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 1.113s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:31 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:31 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a Sep 02 00:12:31 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Deleted volume successfully. Sep 02 00:12:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b3eb8010-459d-4e30-bc58-1ab7591ec75b tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-2348f2a3-9108-4992-8c10-15ced4107923-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:32 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a" returned: 0 in 0.936s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:32 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a Sep 02 00:12:32 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:33 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b753fbc9-df80-4196-ae99-6b7875ad911a" returned: 0 in 0.731s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-b753fbc9-df80-4196-ae99-6b7875ad911a" released by "delete_volume" :: held 1.777s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Created reservations ['6e28f774-f596-4f73-947f-438c1b7d30fb', '7716f578-b486-4915-8803-6dab91f16177', '23655c00-3cd5-4120-8c1a-374f3f296777', 'af23e612-9455-467b-ae9f-b072eda778e9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:33 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:33 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:33 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2" returned: 0 in 5.959s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:12:33 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Converted 1024.00 MB image at 171.81 MB/s Sep 02 00:12:33 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 is being set with open permissions: ugo+rw Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:33 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 Sep 02 00:12:33 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-quobyte-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:33 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.510s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Deleted volume successfully. Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd0c628-eb21-4c17-b813-1678f0dab33a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7f5e7d96-71f9-4246-9df3-0fca56e3201e tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-b753fbc9-df80-4196-ae99-6b7875ad911a-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:34 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:34 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e Sep 02 00:12:34 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-639b0c31-ed13-44a3-b7ec-edac77673cd2" released by "_copy_volume_from_snapshot" :: held 7.204s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-81b6d696-cbea-4671-b4b9-69fb11f2f03e-639b0c31-ed13-44a3-b7ec-edac77673cd2" released by "_create_volume_from_snapshot" :: held 7.297s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.332s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.034s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Creating offline snapshot 0f94b3a7-d8d5-4549-89a8-18d9fab38942 of volume a6cc75db-aa76-4593-870b-629ea6aa0750 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b531d58-3b39-4a19-866e-5230cee23d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639b0c31-ed13-44a3-b7ec-edac77673cd2', 'volume_size': 1, 'snapshot_id': '81b6d696-cbea-4671-b4b9-69fb11f2f03e'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d7b0a1-fed7-4475-ab5b-7ba50ee1e0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2529e455-0e2b-4292-8960-ba554f1629ee]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Volume volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 (639b0c31-ed13-44a3-b7ec-edac77673cd2): created successfully Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d7b0a1-fed7-4475-ab5b-7ba50ee1e0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Flow 'volume_create_manager' (78a1c1b7-1e95-4909-9f10-ba554e351837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-477e84cf-a927-45a3-aa46-b8a4e29f482a tempest-VolumeDependencyTests-890930905 None] Created volume successfully. Sep 02 00:12:34 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 Sep 02 00:12:34 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:34 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:34 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e Sep 02 00:12:34 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:34 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:34 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750" returned: 0 in 0.460s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e" released by "delete_volume" :: held 0.796s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:34 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 1G Sep 02 00:12:34 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Created reservations ['f0824c82-ed02-435b-b3a3-f644e32bf0fc', 'a6398688-069e-4dae-9146-ab294e01fdef', '3a63fef0-a4eb-497b-8292-bd96415648e0', 'f53e5a3a-248d-4bf5-9b50-b7e71d2f632b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "cinder-81b6d696-cbea-4671-b4b9-69fb11f2f03e-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-81b6d696-cbea-4671-b4b9-69fb11f2f03e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "cinder-quobyte-ad0233d1-069e-4354-adc9-ad4332df6200" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-ad0233d1-069e-4354-adc9-ad4332df6200" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "cinder-quobyte-81b6d696-cbea-4671-b4b9-69fb11f2f03e" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:34 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:34 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-81b6d696-cbea-4671-b4b9-69fb11f2f03e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Deleting offline snapshot 81b6d696-cbea-4671-b4b9-69fb11f2f03e of volume ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] snapshot_file for this snap is: volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-e64c0815-f93e-4f77-8756-317463f402ca-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e3ed4a-e4b7-4eb6-ad1b-94016459c3e6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-e64c0815-f93e-4f77-8756-317463f402ca-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-quobyte-e64c0815-f93e-4f77-8756-317463f402ca" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-e64c0815-f93e-4f77-8756-317463f402ca" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[42163b18-1c34-4278-8714-69b4b20aad1f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:35 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e Sep 02 00:12:35 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:35 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:35 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 1G" returned: 0 in 0.663s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6cc75db-aa76-4593-870b-629ea6aa0750 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Deleted volume successfully. Sep 02 00:12:35 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca Sep 02 00:12:35 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:35 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6cc75db-aa76-4593-870b-629ea6aa0750 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 Sep 02 00:12:35 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19c8d7db-4751-4a6f-853d-5e9a62fbda47 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-3eda16fc-95ce-4ad4-bb97-efb7e6a2152e-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:35 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad0233d1-069e-4354-adc9-ad4332df6200(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa76e36-6859-4596-a876-2818df91875a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:35 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:35 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 Sep 02 00:12:35 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:35 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca Sep 02 00:12:35 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:35 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6cc75db-aa76-4593-870b-629ea6aa0750 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942" returned: 0 in 0.378s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:35 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 is being set with open permissions: ugo+rw Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:35 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 Sep 02 00:12:35 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:35 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-e64c0815-f93e-4f77-8756-317463f402ca" returned: 0 in 0.336s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:35 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942" returned: 0 in 0.292s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-e64c0815-f93e-4f77-8756-317463f402ca" released by "delete_volume" :: held 0.876s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:36 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.info Sep 02 00:12:36 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Created reservations ['328e0103-6625-4706-92b6-e2012179e5d8', 'bb10deae-0fce-43c1-bfd6-3f43672d02b8', '8175c7cc-6eb5-464a-a5bd-74e76e6f2b54', '97bb2ba2-6e08-44d6-b2ab-05566a2d9d06'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:36 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200" returned: 0 in 0.717s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:36 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e Sep 02 00:12:36 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:36 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:36 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (a357bdf0-d588-42fa-a772-bd7740e18029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065defa4-8195-456e-8311-af81a9734dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065defa4-8195-456e-8311-af81a9734dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034527088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854529c5-97c4-4dff-ae1a-e855993ab22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:36Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:36 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f301699-511b-4812-9e76-db40ccca8933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f301699-511b-4812-9e76-db40ccca8933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e633be4d-ac9d-413b-8fe5-620e55d3ab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e633be4d-ac9d-413b-8fe5-620e55d3ab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '854529c5-97c4-4dff-ae1a-e855993ab22b', 'volume_name': 'volume-854529c5-97c4-4dff-ae1a-e855993ab22b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5bfa92-abbf-41b2-b3b0-f51616ee7d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5bfa92-abbf-41b2-b3b0-f51616ee7d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5efd647-2e29-4202-92b1-15c3c4208f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Volume 854529c5-97c4-4dff-ae1a-e855993ab22b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-854529c5-97c4-4dff-ae1a-e855993ab22b', 'volume_size': 1} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.info" returned: 0 in 0.386s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:36 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.info is being set with open permissions: ugo+rw Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:36 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.info Sep 02 00:12:36 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:36 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.298s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Deleted volume successfully. Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e73e8824-0641-431d-8f0c-0ac193804790 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-e64c0815-f93e-4f77-8756-317463f402ca-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:36 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e" returned: 0 in 0.377s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:36 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e Sep 02 00:12:36 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:36 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.info" returned: 0 in 0.269s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.293s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034527088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854529c5-97c4-4dff-ae1a-e855993ab22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:36Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Creating volume 854529c5-97c4-4dff-ae1a-e855993ab22b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:36 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:36 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b 1073741824 Sep 02 00:12:36 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c1ebce09-d1d5-4494-9c88-394895cf4fd4 tempest-ProjectMemberTests-204781831 None] Create snapshot completed successfully Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-0f94b3a7-d8d5-4549-89a8-18d9fab38942-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:36 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200.81b6d696-cbea-4671-b4b9-69fb11f2f03e" returned: 0 in 0.299s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Lock "cinder-0f94b3a7-d8d5-4549-89a8-18d9fab38942-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-a6cc75db-aa76-4593-870b-629ea6aa0750" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-81b6d696-cbea-4671-b4b9-69fb11f2f03e" released by "_delete_snapshot" :: held 2.034s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-a6cc75db-aa76-4593-870b-629ea6aa0750" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-0f94b3a7-d8d5-4549-89a8-18d9fab38942" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-ad0233d1-069e-4354-adc9-ad4332df6200" released by "delete_snapshot" :: held 2.069s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-0f94b3a7-d8d5-4549-89a8-18d9fab38942" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Deleting offline snapshot 0f94b3a7-d8d5-4549-89a8-18d9fab38942 of volume a6cc75db-aa76-4593-870b-629ea6aa0750 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] snapshot_file for this snap is: volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1787c58-9915-4574-9bd3-aa30949eded1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Created reservations ['0a654933-b923-44b4-9098-29dc47d7909a', 'de30150a-6611-4fe2-acd5-40244674e15e', 'fc562696-de45-4a7a-b177-6d6443146b62', 'c86d1e65-7179-4a30-8b02-59854c19ac7d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:37 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 Sep 02 00:12:37 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Delete snapshot completed successfully. Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-72d8cb51-1992-4c2f-9e4d-c583a9284c51 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-81b6d696-cbea-4671-b4b9-69fb11f2f03e-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:37 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b 1073741824" returned: 0 in 0.485s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:37 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-0b3933e8-95c6-4e07-9afa-0379275fb0e1-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:37 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-0b3933e8-95c6-4e07-9afa-0379275fb0e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-quobyte-28c119cf-64c8-4336-aa71-f87d96bf020b" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-28c119cf-64c8-4336-aa71-f87d96bf020b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-quobyte-0b3933e8-95c6-4e07-9afa-0379275fb0e1" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-0b3933e8-95c6-4e07-9afa-0379275fb0e1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Deleting offline snapshot 0b3933e8-95c6-4e07-9afa-0379275fb0e1 of volume 28c119cf-64c8-4336-aa71-f87d96bf020b {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] snapshot_file for this snap is: volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dac55a-5543-48ca-a394-888c3c6a6eb5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:37 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6cc75db-aa76-4593-870b-629ea6aa0750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[980559da-57ce-4a49-9ee3-de2cd2eda304]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:37 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 Sep 02 00:12:37 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:37 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5efd647-2e29-4202-92b1-15c3c4208f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-854529c5-97c4-4dff-ae1a-e855993ab22b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1b8787-cfc5-44bc-a60b-57ec019addc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Volume volume-854529c5-97c4-4dff-ae1a-e855993ab22b (854529c5-97c4-4dff-ae1a-e855993ab22b): created successfully Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1b8787-cfc5-44bc-a60b-57ec019addc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (a357bdf0-d588-42fa-a772-bd7740e18029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:37 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 Sep 02 00:12:37 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-768b9ac0-904f-4833-a64f-9340500ebb25 tempest-ProjectReaderTests-1147775413 None] Created volume successfully. Sep 02 00:12:37 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1" returned: 0 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28c119cf-64c8-4336-aa71-f87d96bf020b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29a6ca1-25b4-42ac-be92-de1e672c1af8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:37 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:37 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 Sep 02 00:12:37 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:37 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b Sep 02 00:12:37 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "cinder-ad0233d1-069e-4354-adc9-ad4332df6200-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-ad0233d1-069e-4354-adc9-ad4332df6200-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "cinder-quobyte-ad0233d1-069e-4354-adc9-ad4332df6200" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-ad0233d1-069e-4354-adc9-ad4332df6200" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc51c58-5b4f-4fa0-b2db-7853bb7422ed]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:38 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b" returned: 0 in 0.410s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:38 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 Sep 02 00:12:38 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:38 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942" returned: 0 in 0.395s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:38 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942 Sep 02 00:12:38 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:38 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 Sep 02 00:12:38 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:38 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750.0f94b3a7-d8d5-4549-89a8-18d9fab38942" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-0f94b3a7-d8d5-4549-89a8-18d9fab38942" released by "_delete_snapshot" :: held 1.589s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-a6cc75db-aa76-4593-870b-629ea6aa0750" released by "delete_snapshot" :: held 1.637s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:38 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200" returned: 0 in 0.455s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:38 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1" returned: 0 in 0.458s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:38 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200 Sep 02 00:12:38 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:38 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1 Sep 02 00:12:38 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Creating offline snapshot b6c1665c-d19f-4209-b225-bcc116f98f7c of volume 854529c5-97c4-4dff-ae1a-e855993ab22b {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a725e38c-bd2e-47d3-aa5a-19b427f958a2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Created reservations ['34e0b5db-0036-4a68-9dcd-2df5e5c2d231', '8cd5e177-ce4b-4a59-8ce2-396c34b24b6c', 'ec1a83aa-247f-4e7b-b434-69f5870924c2', '1ff19617-3d81-47e8-a3c5-3fd37d73aaa6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Delete snapshot completed successfully. Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3e289a73-1161-4698-a3ca-933ee422bbed tempest-ProjectMemberTests-204781831 None] Lock "cinder-0f94b3a7-d8d5-4549-89a8-18d9fab38942-delete_snapshot" released by "delete_snapshot" :: held 1.913s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:38 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b Sep 02 00:12:38 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:38 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ad0233d1-069e-4354-adc9-ad4332df6200" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:38 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-ad0233d1-069e-4354-adc9-ad4332df6200" released by "delete_volume" :: held 0.801s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b.0b3933e8-95c6-4e07-9afa-0379275fb0e1" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-0b3933e8-95c6-4e07-9afa-0379275fb0e1" released by "_delete_snapshot" :: held 1.655s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-28c119cf-64c8-4336-aa71-f87d96bf020b" released by "delete_snapshot" :: held 1.682s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Created reservations ['7e9f53b8-1b2d-478f-b0b7-ce6f2c4bfc8d', '830d0367-ef36-499f-a608-967a1dfddb32', 'd6fec455-c317-406c-92b3-fc7144974cea', 'f2934c02-5a1e-4efa-86f4-c88082225af7'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Created reservations ['d1a9c371-4604-4a87-afbb-51a7f73c7a16', 'c27f3f70-ce33-430d-a1ba-a56133d68097', '9c45d512-a0a0-4f62-8e0a-07f54af53f13', '5efcba12-be5f-4169-aac0-698e3466e389'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-a6cc75db-aa76-4593-870b-629ea6aa0750-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Lock "cinder-a6cc75db-aa76-4593-870b-629ea6aa0750-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:39 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b" returned: 0 in 0.496s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:39 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:39 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:39 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c 1G Sep 02 00:12:39 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "cinder-639b0c31-ed13-44a3-b7ec-edac77673cd2-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-a6cc75db-aa76-4593-870b-629ea6aa0750" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Delete snapshot completed successfully. Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-a6cc75db-aa76-4593-870b-629ea6aa0750" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-53dad30e-ef94-49f4-bb7b-cbd8d3bfc3c9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-0b3933e8-95c6-4e07-9afa-0379275fb0e1-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-639b0c31-ed13-44a3-b7ec-edac77673cd2-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a3ff4b-ee65-4fd2-ab78-aae3fbbee71e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:39 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 Sep 02 00:12:39 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-28c119cf-64c8-4336-aa71-f87d96bf020b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:39 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "cinder-quobyte-639b0c31-ed13-44a3-b7ec-edac77673cd2" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.336s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Deleted volume successfully. Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-28c119cf-64c8-4336-aa71-f87d96bf020b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-639b0c31-ed13-44a3-b7ec-edac77673cd2" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37f975d-1abd-4f7e-a11b-ae1b224cba12]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f4b7e106-2279-42c0-99e9-a7e222cf3413 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-ad0233d1-069e-4354-adc9-ad4332df6200-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "cinder-quobyte-28c119cf-64c8-4336-aa71-f87d96bf020b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-28c119cf-64c8-4336-aa71-f87d96bf020b" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3f1a4b-7e32-4a33-ba6e-a8f04240b17b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:39 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 Sep 02 00:12:39 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:39 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c 1G" returned: 0 in 0.554s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-854529c5-97c4-4dff-ae1a-e855993ab22b -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:39 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-854529c5-97c4-4dff-ae1a-e855993ab22b -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c Sep 02 00:12:39 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:39 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750" returned: 0 in 0.463s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:39 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b Sep 02 00:12:39 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:39 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750 Sep 02 00:12:39 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:39 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2" returned: 0 in 0.435s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:40 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2 Sep 02 00:12:40 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:40 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a6cc75db-aa76-4593-870b-629ea6aa0750" returned: 0 in 0.267s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:40 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-854529c5-97c4-4dff-ae1a-e855993ab22b -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c" returned: 0 in 0.324s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:40 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c is being set with open permissions: ugo+rw Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-a6cc75db-aa76-4593-870b-629ea6aa0750" released by "delete_volume" :: held 0.810s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:40 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:40 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c Sep 02 00:12:40 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:40 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b Sep 02 00:12:40 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Created reservations ['2277b671-e78b-4780-a939-2860ef318fa4', 'e7e7d84c-3632-4068-8ad8-5141a29b3241', 'bb62acc2-de28-4535-b119-3be0a03dd020', '8f759379-939e-42fd-b49c-06208d1a8400'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:40 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-639b0c31-ed13-44a3-b7ec-edac77673cd2" returned: 0 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:40 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:40 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-quobyte-639b0c31-ed13-44a3-b7ec-edac77673cd2" released by "delete_volume" :: held 0.872s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:40 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-28c119cf-64c8-4336-aa71-f87d96bf020b" returned: 0 in 0.322s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-quobyte-28c119cf-64c8-4336-aa71-f87d96bf020b" released by "delete_volume" :: held 0.803s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:40 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c" returned: 0 in 0.407s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Created reservations ['817ed626-ec8b-4aef-ba9e-fefec8be7fb3', '60906080-a5ec-45bf-9af8-ddc26c19f50e', 'fbad9df0-2317-4afe-bfee-70a694e7c1c3', '231080a5-d060-4315-8904-32089f461806'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Created reservations ['ec2643ff-5cac-4d22-b0df-0f24641eb5c1', 'e530d295-6f61-447d-a3f0-07a619e9315e', '71016842-b6be-4a97-ab01-99625fc61102', '2c6c607e-1f26-49bf-9929-5e28bf5b0c8e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:40 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.info Sep 02 00:12:40 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:40 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.278s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Deleted volume successfully. Sep 02 00:12:40 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:40 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-29e131e4-ffa8-4902-95ca-8f17d44c0c70 tempest-ProjectMemberTests-204781831 None] Lock "cinder-a6cc75db-aa76-4593-870b-629ea6aa0750-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:40 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:40 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:40 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.info" returned: 0 in 0.308s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:40 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.info is being set with open permissions: ugo+rw Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:40 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.info Sep 02 00:12:40 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:40 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.337s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Deleted volume successfully. Sep 02 00:12:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9df343d6-9a30-4c91-92b2-a584fc068749 tempest-VolumeDependencyTests-890930905 None] Lock "cinder-639b0c31-ed13-44a3-b7ec-edac77673cd2-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:40 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.289s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Deleted volume successfully. Sep 02 00:12:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-acd8bc58-c9f8-4707-bbff-dadd9d4ea4e9 tempest-CreateVolumesFromSnapshotTest-77644943 None] Lock "cinder-28c119cf-64c8-4336-aa71-f87d96bf020b-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:41 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.info" returned: 0 in 0.270s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9e948064-2ada-48f0-a7b3-bdc281603bc6 tempest-ProjectReaderTests-1147775413 None] Create snapshot completed successfully Sep 02 00:12:41 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (0dc97c78-756a-4ab4-9dea-1d79fbb28510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123724d5-cf23-48af-98be-ea7338897860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123724d5-cf23-48af-98be-ea7338897860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568401260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4d2e74-8384-4108-8280-612e24e24ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:42Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e648fa1f-357e-41cb-be4b-12a04bde39d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e648fa1f-357e-41cb-be4b-12a04bde39d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e68c31-80f6-4123-ad86-e4e963c2ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e68c31-80f6-4123-ad86-e4e963c2ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4d2e74-8384-4108-8280-612e24e24ae3', 'volume_name': 'volume-7a4d2e74-8384-4108-8280-612e24e24ae3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51bdbfe8-6f7e-4644-9e1d-c3427879b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51bdbfe8-6f7e-4644-9e1d-c3427879b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7222c4fd-f293-4dce-949b-db8fa510f23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Volume 7a4d2e74-8384-4108-8280-612e24e24ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4d2e74-8384-4108-8280-612e24e24ae3', 'volume_size': 1} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568401260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4d2e74-8384-4108-8280-612e24e24ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:42Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Creating volume 7a4d2e74-8384-4108-8280-612e24e24ae3 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:42 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:42 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 1073741824 Sep 02 00:12:42 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-b6c1665c-d19f-4209-b225-bcc116f98f7c-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-b6c1665c-d19f-4209-b225-bcc116f98f7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-854529c5-97c4-4dff-ae1a-e855993ab22b" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-854529c5-97c4-4dff-ae1a-e855993ab22b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-b6c1665c-d19f-4209-b225-bcc116f98f7c" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-b6c1665c-d19f-4209-b225-bcc116f98f7c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Deleting offline snapshot b6c1665c-d19f-4209-b225-bcc116f98f7c of volume 854529c5-97c4-4dff-ae1a-e855993ab22b {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] snapshot_file for this snap is: volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e130c779-0dac-4084-a080-719e0af0fc50]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:42 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c Sep 02 00:12:42 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:42 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:42 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 1073741824" returned: 0 in 0.556s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:42 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c" returned: 0 in 0.532s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:42 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-854529c5-97c4-4dff-ae1a-e855993ab22b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83772a6-7ac9-4d74-9bc0-80138ebc4e1c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:43 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b Sep 02 00:12:43 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:43 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=267,cinder:SELECT=200,cinder:INSERT=78,cinder:DELETE=28 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7222c4fd-f293-4dce-949b-db8fa510f23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4d2e74-8384-4108-8280-612e24e24ae3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887be93f-0283-4562-a0e4-ecde2e2e0681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=222,cinder:UPDATE=278,cinder:INSERT=74,cinder:DELETE=20 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:12:43 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Volume volume-7a4d2e74-8384-4108-8280-612e24e24ae3 (7a4d2e74-8384-4108-8280-612e24e24ae3): created successfully Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887be93f-0283-4562-a0e4-ecde2e2e0681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (0dc97c78-756a-4ab4-9dea-1d79fbb28510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7818863c-5233-45e0-a997-fd852c4fa1fb tempest-ProjectMemberTests-204781831 None] Created volume successfully. Sep 02 00:12:43 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b" returned: 0 in 0.579s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:43 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c Sep 02 00:12:43 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:43 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:43 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c Sep 02 00:12:43 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:44 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b.b6c1665c-d19f-4209-b225-bcc116f98f7c" returned: 0 in 0.317s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-b6c1665c-d19f-4209-b225-bcc116f98f7c" released by "_delete_snapshot" :: held 1.987s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-854529c5-97c4-4dff-ae1a-e855993ab22b" released by "delete_snapshot" :: held 2.037s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Created reservations ['a372a835-102a-4a85-8f7f-5dff61476aef', '76521565-af6c-4d99-806b-81cff70bd6b1', 'be279956-d4db-470b-b46c-00a9fd7060b1', '9a6a3e2e-3b82-4c01-b9e9-ba66ff2d6ade'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Delete snapshot completed successfully. Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a9ffed31-d979-46d5-9be0-2364ca29140e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-b6c1665c-d19f-4209-b225-bcc116f98f7c-delete_snapshot" released by "delete_snapshot" :: held 2.260s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (8188846f-e909-44ee-855e-3cf9fed5260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3607210-6772-4cb3-b8d2-aed7839f5a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3607210-6772-4cb3-b8d2-aed7839f5a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688207717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099b4956-e85d-46a7-802e-5c25595996cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:44Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324ffdea-7c52-4ea5-80aa-5216348e6ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324ffdea-7c52-4ea5-80aa-5216348e6ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008c843d-f66e-429f-9121-e24aeeddcfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008c843d-f66e-429f-9121-e24aeeddcfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '099b4956-e85d-46a7-802e-5c25595996cf', 'volume_name': 'volume-099b4956-e85d-46a7-802e-5c25595996cf', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ede466-defb-44eb-89e1-139afce79104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ede466-defb-44eb-89e1-139afce79104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce052055-e908-4c85-a2fb-163dfb78f917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:44 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume 099b4956-e85d-46a7-802e-5c25595996cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-099b4956-e85d-46a7-802e-5c25595996cf', 'volume_size': 1} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Creating offline snapshot 5d5f55d6-2146-4101-876a-25007fae11d7 of volume 7a4d2e74-8384-4108-8280-612e24e24ae3 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[01164723-6d04-4e85-95e4-6f16fdb4866c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:44 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 Sep 02 00:12:44 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:45 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3" returned: 0 in 0.376s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:45 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 1G Sep 02 00:12:45 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-854529c5-97c4-4dff-ae1a-e855993ab22b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Lock "cinder-854529c5-97c4-4dff-ae1a-e855993ab22b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:45 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 1G" returned: 0 in 0.499s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a4d2e74-8384-4108-8280-612e24e24ae3 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-854529c5-97c4-4dff-ae1a-e855993ab22b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:45 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a4d2e74-8384-4108-8280-612e24e24ae3 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 Sep 02 00:12:45 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-854529c5-97c4-4dff-ae1a-e855993ab22b" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eded0d-8e9a-46e2-99db-872fdfe6f99c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:45 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b Sep 02 00:12:45 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:45 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a4d2e74-8384-4108-8280-612e24e24ae3 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:45 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 is being set with open permissions: ugo+rw Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:45 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 Sep 02 00:12:45 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:45 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b" returned: 0 in 0.392s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:46 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b Sep 02 00:12:46 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:46 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7" returned: 0 in 0.260s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:46 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.info Sep 02 00:12:46 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:46 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-854529c5-97c4-4dff-ae1a-e855993ab22b" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-854529c5-97c4-4dff-ae1a-e855993ab22b" released by "delete_volume" :: held 0.707s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Created reservations ['ee6a6294-b3c7-42b0-a37c-b144c0373c88', '1b8d141a-431b-4632-871b-a7bbe5e4ed5d', '95ef45f5-173e-4f7f-b471-ac15e4c8cfa2', '43697e76-5846-46f7-9b0e-451d692d2ce0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:46 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.info" returned: 0 in 0.293s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:46 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.info is being set with open permissions: ugo+rw Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:46 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:46 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:46 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.info Sep 02 00:12:46 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:46 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.264s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Deleted volume successfully. Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8340d2f4-5835-4181-84c7-eb2e4a4e24bb tempest-ProjectReaderTests-1147775413 None] Lock "cinder-854529c5-97c4-4dff-ae1a-e855993ab22b-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:46 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.info" returned: 0 in 0.296s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.147s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688207717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099b4956-e85d-46a7-802e-5c25595996cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:44Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Creating volume 099b4956-e85d-46a7-802e-5c25595996cf {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:46 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:46 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf 1073741824 Sep 02 00:12:46 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d322c8da-93b4-4806-91b1-59507cff2baf tempest-ProjectMemberTests-204781831 None] Create snapshot completed successfully Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (4111949a-a601-4f07-87b2-29a8b5bd5183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9efd4d-dfc8-40b5-b6a0-24e323dff1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9efd4d-dfc8-40b5-b6a0-24e323dff1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2038522079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:47Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1af722a-0426-4d3f-a8e6-c94326210ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1af722a-0426-4d3f-a8e6-c94326210ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768618b4-9f32-45d5-bd32-c5e5bd4885c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768618b4-9f32-45d5-bd32-c5e5bd4885c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249', 'volume_name': 'volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d3a7c1-3854-4d7e-9a65-9c9673c76f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d3a7c1-3854-4d7e-9a65-9c9673c76f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ef8257-88fc-4564-bff0-b44ea89d0eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Volume 6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249', 'volume_size': 1} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:47 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf 1073741824" returned: 0 in 0.498s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:47 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf Sep 02 00:12:47 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:47 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf" returned: 0 in 0.291s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2038522079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:47Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Creating volume 6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:47 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-5d5f55d6-2146-4101-876a-25007fae11d7-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce052055-e908-4c85-a2fb-163dfb78f917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099b4956-e85d-46a7-802e-5c25595996cf', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:47 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 1073741824 Sep 02 00:12:47 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7ff890-cdce-4c33-a360-ec7b8dc82596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-5d5f55d6-2146-4101-876a-25007fae11d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-7a4d2e74-8384-4108-8280-612e24e24ae3" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume volume-099b4956-e85d-46a7-802e-5c25595996cf (099b4956-e85d-46a7-802e-5c25595996cf): created successfully Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7ff890-cdce-4c33-a360-ec7b8dc82596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (8188846f-e909-44ee-855e-3cf9fed5260d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-7a4d2e74-8384-4108-8280-612e24e24ae3" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-5d5f55d6-2146-4101-876a-25007fae11d7" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2d349557-bd78-4219-aa58-84d3c3872037 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created volume successfully. Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-5d5f55d6-2146-4101-876a-25007fae11d7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Deleting offline snapshot 5d5f55d6-2146-4101-876a-25007fae11d7 of volume 7a4d2e74-8384-4108-8280-612e24e24ae3 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] snapshot_file for this snap is: volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d432a934-e193-44f0-bbaa-47dfa7eedeb6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:47 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 Sep 02 00:12:47 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:48 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 1073741824" returned: 0 in 0.537s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:48 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:48 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7" returned: 0 in 0.448s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:48 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a4d2e74-8384-4108-8280-612e24e24ae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da508e-0b87-4368-b82e-93a86e4d2da3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:48 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 Sep 02 00:12:48 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:48 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ef8257-88fc-4564-bff0-b44ea89d0eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beeadd9-95de-4bce-9829-b4ac1019bc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Volume volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 (6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249): created successfully Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beeadd9-95de-4bce-9829-b4ac1019bc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (4111949a-a601-4f07-87b2-29a8b5bd5183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2d9996af-3776-43d4-a6d1-83c1f13d7c7d tempest-ProjectReaderTests-1147775413 None] Created volume successfully. Sep 02 00:12:48 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:48 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 Sep 02 00:12:48 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:49 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:49 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7 Sep 02 00:12:49 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (34bb890f-4a79-4226-9f86-df6105920c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0f6256-a33f-4d9a-b946-b107a9846bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0f6256-a33f-4d9a-b946-b107a9846bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-430225196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66841275-683b-44e2-a426-f994683135e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:49Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad3ceca-8908-4875-8644-256737a5fdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad3ceca-8908-4875-8644-256737a5fdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f1a1fa-560d-439b-90b0-55d26d797111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f1a1fa-560d-439b-90b0-55d26d797111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66841275-683b-44e2-a426-f994683135e9', 'volume_name': 'volume-66841275-683b-44e2-a426-f994683135e9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8281edd1-740a-4286-931e-1747c7156633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8281edd1-740a-4286-931e-1747c7156633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a7113e-2436-4bc7-9c1c-6c33065ada8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume 66841275-683b-44e2-a426-f994683135e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66841275-683b-44e2-a426-f994683135e9', 'volume_size': 1} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-430225196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66841275-683b-44e2-a426-f994683135e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:49Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Creating volume 66841275-683b-44e2-a426-f994683135e9 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:49 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:49 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9 1073741824 Sep 02 00:12:49 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:49 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3.5d5f55d6-2146-4101-876a-25007fae11d7" returned: 0 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-5d5f55d6-2146-4101-876a-25007fae11d7" released by "_delete_snapshot" :: held 1.756s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-7a4d2e74-8384-4108-8280-612e24e24ae3" released by "delete_snapshot" :: held 1.802s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Created reservations ['0bf2cd89-ef6a-40bc-819f-df24aad63717', '8ed04635-c5fe-4588-bbb1-21375c96f1ba', '6114af1f-4ec0-40a2-86f8-1c8af4902ea4', 'e31f58be-e62b-4574-ad38-85443253e7c9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Delete snapshot completed successfully. Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3502f210-213c-4eff-965a-de55c79871f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-5d5f55d6-2146-4101-876a-25007fae11d7-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-7a4d2e74-8384-4108-8280-612e24e24ae3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Lock "cinder-7a4d2e74-8384-4108-8280-612e24e24ae3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:49 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9 1073741824" returned: 0 in 0.641s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-7a4d2e74-8384-4108-8280-612e24e24ae3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-7a4d2e74-8384-4108-8280-612e24e24ae3" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32b472c-7392-4e01-995b-0566cd440506]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:50 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9 Sep 02 00:12:50 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (d15389e3-eba9-49b0-8a9c-d53217c5fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f92cc84-b57d-4718-b7a6-f2f2577998e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f92cc84-b57d-4718-b7a6-f2f2577998e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1686078949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea82685-877f-4837-8173-922d005a947f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:50Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd1ec94-70d1-4b3c-b182-5f3a15613215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd1ec94-70d1-4b3c-b182-5f3a15613215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 Sep 02 00:12:50 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10dae2a-2f58-42f0-a5a6-96774ea772f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10dae2a-2f58-42f0-a5a6-96774ea772f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea82685-877f-4837-8173-922d005a947f', 'volume_name': 'volume-fea82685-877f-4837-8173-922d005a947f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f825f6-2e94-4257-b6b0-0dae686b7dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f825f6-2e94-4257-b6b0-0dae686b7dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615a168b-fd7d-4ef2-8e4c-f8f7393bcdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume fea82685-877f-4837-8173-922d005a947f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea82685-877f-4837-8173-922d005a947f', 'volume_size': 1} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:50 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.611s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a7113e-2436-4bc7-9c1c-6c33065ada8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66841275-683b-44e2-a426-f994683135e9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d24ecfc-3c81-4f48-b5a0-3418842d9894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Creating offline snapshot 87684ace-27e3-4fa7-adf4-2b4474844d14 of volume 6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume volume-66841275-683b-44e2-a426-f994683135e9 (66841275-683b-44e2-a426-f994683135e9): created successfully Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d24ecfc-3c81-4f48-b5a0-3418842d9894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (34bb890f-4a79-4226-9f86-df6105920c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[43db047f-6c50-4a13-b1e9-39c18ae9f431]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (d74ff909-c156-4426-993a-8e258da400bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5c4e42-3521-413d-ab04-a874f946cc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c74f0a96-30fa-4ab1-a820-58ae450e060f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created volume successfully. Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5c4e42-3521-413d-ab04-a874f946cc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955925912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d816cd5e-fa9c-4680-9870-edfc5feebfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:50Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dcacfa-7478-4081-9735-5b387a83fa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dcacfa-7478-4081-9735-5b387a83fa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fef94e-ff45-4cd5-8d73-fef4348392e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fef94e-ff45-4cd5-8d73-fef4348392e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd816cd5e-fa9c-4680-9870-edfc5feebfaf', 'volume_name': 'volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25700722-ddc8-4661-a7ab-d0f070296af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25700722-ddc8-4661-a7ab-d0f070296af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7c491f-f005-444c-a5bc-39cd78383b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume d816cd5e-fa9c-4680-9870-edfc5feebfaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf', 'volume_size': 1} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:50 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 Sep 02 00:12:50 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:50 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3" returned: 0 in 0.667s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:50 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3 Sep 02 00:12:50 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:51 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" returned: 0 in 0.527s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:51 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 1G Sep 02 00:12:51 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:51 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (fed6caf4-3ab7-45ba-86cc-5cb77255b61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e9580c-ae27-4b76-bece-76a67ba8a4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7a4d2e74-8384-4108-8280-612e24e24ae3" returned: 0 in 0.461s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e9580c-ae27-4b76-bece-76a67ba8a4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620090871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd6e2a5-0da2-4cec-be84-476bd05b1b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:51Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f811a9c1-06c2-489e-baee-1972955e474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f811a9c1-06c2-489e-baee-1972955e474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed299f24-4c8f-4a82-8e5b-eaaa393bf38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed299f24-4c8f-4a82-8e5b-eaaa393bf38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd6e2a5-0da2-4cec-be84-476bd05b1b21', 'volume_name': 'volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2476f2b0-d21a-4280-bf68-fbe46c297202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2476f2b0-d21a-4280-bf68-fbe46c297202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e39472-cacd-44e8-8ea5-463aeb9eb2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume 5bd6e2a5-0da2-4cec-be84-476bd05b1b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21', 'volume_size': 1} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-7a4d2e74-8384-4108-8280-612e24e24ae3" released by "delete_volume" :: held 1.302s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Created reservations ['9b2ab271-7c04-47d0-8faa-f472cbd0419a', '768597aa-6a46-4aac-a188-2180cfe33f76', 'd827ae10-7efd-4c36-89b7-1d117781b8ba', '91c86fc6-3306-4c63-acf9-a82efde16aa0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:51 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:51 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:51 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 1G" returned: 0 in 0.537s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:51 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 Sep 02 00:12:51 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:51 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Deleted volume successfully. Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89c8cde5-16ad-4aaf-8bbe-15deaa8c18be tempest-ProjectMemberTests-204781831 None] Lock "cinder-7a4d2e74-8384-4108-8280-612e24e24ae3-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (060071ea-d6fa-43d8-974c-5072e703ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e712129-87ca-4906-8d66-12681a5dac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e712129-87ca-4906-8d66-12681a5dac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-228360997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10102e0d-2fe6-47f9-9fdf-51bb4a34d988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:52Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a45915e-2900-4e39-8514-c8aee94df8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a45915e-2900-4e39-8514-c8aee94df8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dd7115-5765-4498-b093-456de8274467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dd7115-5765-4498-b093-456de8274467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10102e0d-2fe6-47f9-9fdf-51bb4a34d988', 'volume_name': 'volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1275a729-1407-4fff-bf91-b48506b58a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1275a729-1407-4fff-bf91-b48506b58a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7bc9c1-3dc2-4164-8247-b3d3ea75635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume 10102e0d-2fe6-47f9-9fdf-51bb4a34d988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988', 'volume_size': 1} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:51 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 is being set with open permissions: ugo+rw Sep 02 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:51 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 Sep 02 00:12:51 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:52 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14" returned: 0 in 0.237s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:52 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.info Sep 02 00:12:52 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:52 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.info" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:52 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.info is being set with open permissions: ugo+rw Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:52 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.info Sep 02 00:12:52 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:52 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.info" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.543s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1686078949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea82685-877f-4837-8173-922d005a947f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:50Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Creating volume fea82685-877f-4837-8173-922d005a947f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:52 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:52 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f 1073741824 Sep 02 00:12:52 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-83774d02-1281-46a3-9d80-d9104b77826b tempest-ProjectReaderTests-1147775413 None] Create snapshot completed successfully Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (6c2e47fa-40b7-4bd9-900d-5fe8494e4a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f9fa65-c290-4487-a6bd-d62e160456c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f9fa65-c290-4487-a6bd-d62e160456c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691854436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de9d4f9-4996-436e-abc2-6d035fdaac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:53Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc46bd13-34c4-447d-b59a-076de94deb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc46bd13-34c4-447d-b59a-076de94deb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cceb88-ec39-40a9-b51a-89ba0cd9056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cceb88-ec39-40a9-b51a-89ba0cd9056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de9d4f9-4996-436e-abc2-6d035fdaac41', 'volume_name': 'volume-1de9d4f9-4996-436e-abc2-6d035fdaac41', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf041e8b-2a9a-4101-ad68-4cd5928b822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf041e8b-2a9a-4101-ad68-4cd5928b822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178861e0-cbc4-4d0f-8ddb-bada142b0275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Volume 1de9d4f9-4996-436e-abc2-6d035fdaac41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de9d4f9-4996-436e-abc2-6d035fdaac41', 'volume_size': 1} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:53 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f 1073741824" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:53 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f Sep 02 00:12:53 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:53 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f" returned: 0 in 0.264s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.939s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955925912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d816cd5e-fa9c-4680-9870-edfc5feebfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:50Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Creating volume d816cd5e-fa9c-4680-9870-edfc5feebfaf {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:53 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:53 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf 1073741824 Sep 02 00:12:53 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615a168b-fd7d-4ef2-8e4c-f8f7393bcdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea82685-877f-4837-8173-922d005a947f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe9c820-c865-45fb-ad78-ea9c0d48d704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume volume-fea82685-877f-4837-8173-922d005a947f (fea82685-877f-4837-8173-922d005a947f): created successfully Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe9c820-c865-45fb-ad78-ea9c0d48d704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (d15389e3-eba9-49b0-8a9c-d53217c5fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ea68bdbb-0149-4ceb-b5c5-b3cb0b97278f tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created volume successfully. Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-87684ace-27e3-4fa7-adf4-2b4474844d14-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-87684ace-27e3-4fa7-adf4-2b4474844d14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-87684ace-27e3-4fa7-adf4-2b4474844d14" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-87684ace-27e3-4fa7-adf4-2b4474844d14" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Deleting offline snapshot 87684ace-27e3-4fa7-adf4-2b4474844d14 of volume 6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] snapshot_file for this snap is: volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbeca01-c729-4567-8e18-119bb5cdf441]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:54 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf 1073741824" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:54 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf Sep 02 00:12:54 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:54 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 Sep 02 00:12:54 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:54 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf" returned: 0 in 0.251s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.065s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620090871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd6e2a5-0da2-4cec-be84-476bd05b1b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:51Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Creating volume 5bd6e2a5-0da2-4cec-be84-476bd05b1b21 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7c491f-f005-444c-a5bc-39cd78383b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:54 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 1073741824 Sep 02 00:12:54 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b9989e-e379-4af6-ad02-01ed1354e91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf (d816cd5e-fa9c-4680-9870-edfc5feebfaf): created successfully Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b9989e-e379-4af6-ad02-01ed1354e91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (d74ff909-c156-4426-993a-8e258da400bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:54 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:12:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-24d48cbc-8944-4f15-ae8e-e96ad992be6d tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created volume successfully. Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd10dc3-5c5d-46f0-9b1e-223fdd70e74b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:54 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 Sep 02 00:12:54 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:54 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 1073741824" returned: 0 in 0.467s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:54 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:54 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 Sep 02 00:12:54 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:54 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 Sep 02 00:12:54 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:55 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.243s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-228360997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10102e0d-2fe6-47f9-9fdf-51bb4a34d988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4694a0cd564076b8b6170f5bbb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:52Z,use_quota=True,user_id='a56f5447cd6f41d49c30d86ac662d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Creating volume 10102e0d-2fe6-47f9-9fdf-51bb4a34d988 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:55 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:55 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 1073741824 Sep 02 00:12:55 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e39472-cacd-44e8-8ea5-463aeb9eb2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cfb952-ca8e-4b9d-aa15-9803d902c0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 (5bd6e2a5-0da2-4cec-be84-476bd05b1b21): created successfully Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cfb952-ca8e-4b9d-aa15-9803d902c0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (fed6caf4-3ab7-45ba-86cc-5cb77255b61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-24a55972-29cd-4e54-a840-095facc43ea4 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created volume successfully. Sep 02 00:12:55 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:55 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14 Sep 02 00:12:55 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:55 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249.87684ace-27e3-4fa7-adf4-2b4474844d14" returned: 0 in 0.307s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:55 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 1073741824" returned: 0 in 0.503s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-87684ace-27e3-4fa7-adf4-2b4474844d14" released by "_delete_snapshot" :: held 1.682s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" released by "delete_snapshot" :: held 1.712s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:55 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 Sep 02 00:12:55 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Created reservations ['a14be627-e7d4-4233-aece-13e9b545354b', 'a6967a07-fd84-4ff9-9b4c-faba3c6fd5df', '17161749-ec48-476b-b7c0-fc729cdb569a', '43e4a033-f526-4daa-b79a-73e2c508a462'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Delete snapshot completed successfully. Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0904a156-25e9-412a-be05-07458f241f78 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-87684ace-27e3-4fa7-adf4-2b4474844d14-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:55 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988" returned: 0 in 0.248s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.964s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691854436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de9d4f9-4996-436e-abc2-6d035fdaac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:53Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Creating volume 1de9d4f9-4996-436e-abc2-6d035fdaac41 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:56 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:56 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 1073741824 Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7bc9c1-3dc2-4164-8247-b3d3ea75635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:56 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b68ce6-7b45-43e5-baad-acea24f4fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Volume volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 (10102e0d-2fe6-47f9-9fdf-51bb4a34d988): created successfully Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b68ce6-7b45-43e5-baad-acea24f4fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Flow 'volume_create_manager' (060071ea-d6fa-43d8-974c-5072e703ff94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e554f948-a188-44ed-bab1-029027eaacd8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created volume successfully. Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Lock "cinder-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4424c728-6022-4fd4-9ace-d0d3ffb513d2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:56 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 Sep 02 00:12:56 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:56 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-10102e0d-2fe6-47f9-9fdf-51bb4a34d988-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 1073741824" returned: 0 in 0.464s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-10102e0d-2fe6-47f9-9fdf-51bb4a34d988-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-quobyte-10102e0d-2fe6-47f9-9fdf-51bb4a34d988" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-10102e0d-2fe6-47f9-9fdf-51bb4a34d988" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:56 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 Sep 02 00:12:56 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc50706-ea3d-453a-8d2b-c564d3ec5b77]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:56 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" returned: 0 in 0.452s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:56 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249 Sep 02 00:12:56 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:56 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 Sep 02 00:12:56 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:56 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41" returned: 0 in 0.359s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178861e0-cbc4-4d0f-8ddb-bada142b0275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de9d4f9-4996-436e-abc2-6d035fdaac41', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c80116-35e0-45df-b039-c9e54da0abc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Volume volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 (1de9d4f9-4996-436e-abc2-6d035fdaac41): created successfully Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c80116-35e0-45df-b039-c9e54da0abc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (6c2e47fa-40b7-4bd9-900d-5fe8494e4a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-743ef427-a9aa-410d-8cb2-6f443a7db771 tempest-ProjectMemberTests-204781831 None] Created volume successfully. Sep 02 00:12:56 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" returned: 0 in 0.290s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249" released by "delete_volume" :: held 0.808s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Created reservations ['49a54e75-0794-46bc-804b-5e4d2df98bf4', 'ddf705b9-ea31-42f5-a32e-1c98cd9eff1e', '069d9b8f-fa76-47fd-b3a5-7a475b8d0e94', 'ea29fc78-dc82-45b4-b58c-40f847872c1e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:57 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988" returned: 0 in 0.477s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:57 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988 Sep 02 00:12:57 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:57 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:57 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Creating offline snapshot 2338aad0-4bee-4fab-b4ca-5b46e5e6d55e of volume 1de9d4f9-4996-436e-abc2-6d035fdaac41 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:12:57 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-10102e0d-2fe6-47f9-9fdf-51bb4a34d988" returned: 0 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1c9eac-c2df-4307-937f-3b094e990c5c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-10102e0d-2fe6-47f9-9fdf-51bb4a34d988" released by "delete_volume" :: held 0.927s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:57 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.318s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Deleted volume successfully. Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created reservations ['e059d453-3746-4364-84a0-85b8f42d9815', 'd765969f-2422-4627-ae3a-b7573cf58518', '26c6ffb8-58b0-4ea5-82da-f9550353a35d', '7351b317-1889-4ec3-807e-e32c4b4e3e57'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-722d7395-f3d1-442b-8c49-620a431f06cd tempest-ProjectReaderTests-1147775413 None] Lock "cinder-6c5ea5f0-471f-4d9c-984e-6c1b9e6f7249-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:57 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 Sep 02 00:12:57 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:57 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:57 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:57 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41" returned: 0 in 0.532s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:58 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:12:58 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e 1G Sep 02 00:12:58 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Deleted volume successfully. Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (97b18020-f10f-4834-ab7e-28e1e84097e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165257a6-212a-4dd1-a920-e7c48ab1d7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e79042e-a45f-4178-bebb-5e21b830e227 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-10102e0d-2fe6-47f9-9fdf-51bb4a34d988-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165257a6-212a-4dd1-a920-e7c48ab1d7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998441552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7452fc5d-e363-4327-9a04-226978ab1aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:58Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6515e2ca-5c9b-44c2-965b-6a9f2ad3e66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6515e2ca-5c9b-44c2-965b-6a9f2ad3e66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0769aa4c-38ac-4655-bbb4-2537fcec6324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0769aa4c-38ac-4655-bbb4-2537fcec6324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7452fc5d-e363-4327-9a04-226978ab1aba', 'volume_name': 'volume-7452fc5d-e363-4327-9a04-226978ab1aba', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0015b22a-e2e4-4e0f-a581-ecfef1a35a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0015b22a-e2e4-4e0f-a581-ecfef1a35a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076f16b8-aba8-496f-a8bd-4002b16861a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:12:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Volume 7452fc5d-e363-4327-9a04-226978ab1aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7452fc5d-e363-4327-9a04-226978ab1aba', 'volume_size': 1} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:58 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e 1G" returned: 0 in 0.475s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:58 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e Sep 02 00:12:58 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-5bd6e2a5-0da2-4cec-be84-476bd05b1b21-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-5bd6e2a5-0da2-4cec-be84-476bd05b1b21-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-quobyte-5bd6e2a5-0da2-4cec-be84-476bd05b1b21" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:12:58 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e" returned: 0 in 0.385s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:58 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e is being set with open permissions: ugo+rw Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-5bd6e2a5-0da2-4cec-be84-476bd05b1b21" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:12:58 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e Sep 02 00:12:58 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[232623d4-3a0c-42a0-bae3-bb6f73adffbf]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:12:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:59 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 Sep 02 00:12:59 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:59 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e" returned: 0 in 0.275s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:59 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.info Sep 02 00:12:59 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:59 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:59 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21 Sep 02 00:12:59 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:59 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.info" returned: 0 in 0.328s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:59 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.info is being set with open permissions: ugo+rw Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:59 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.info Sep 02 00:12:59 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:59 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5bd6e2a5-0da2-4cec-be84-476bd05b1b21" returned: 0 in 0.275s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-5bd6e2a5-0da2-4cec-be84-476bd05b1b21" released by "delete_volume" :: held 0.788s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created reservations ['74163e49-fb56-4ee2-8f09-71f44eb19393', 'ea61506b-d030-481a-83a4-c21b73932217', '94943244-07f5-45e6-a72f-5056e4f0c6b5', '0878ad2c-849b-486f-aa5b-25abe823f0b3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:12:59 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.info" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998441552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7452fc5d-e363-4327-9a04-226978ab1aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:12:58Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Creating volume 7452fc5d-e363-4327-9a04-226978ab1aba {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:12:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:59 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba 1073741824 Sep 02 00:12:59 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d4d45129-2657-4e9d-9940-ab2264e01982 tempest-ProjectMemberTests-204781831 None] Create snapshot completed successfully Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:12:59 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:12:59 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:12:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-d816cd5e-fa9c-4680-9870-edfc5feebfaf-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-d816cd5e-fa9c-4680-9870-edfc5feebfaf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-quobyte-d816cd5e-fa9c-4680-9870-edfc5feebfaf" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-d816cd5e-fa9c-4680-9870-edfc5feebfaf" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ee8672-b5b6-4142-bfaf-ddc29556feee]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:00 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Deleted volume successfully. Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-abac94c8-25dd-4285-b73a-3adf7e9ec749 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-5bd6e2a5-0da2-4cec-be84-476bd05b1b21-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:00 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf Sep 02 00:13:00 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:00 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba 1073741824" returned: 0 in 0.610s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:00 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba Sep 02 00:13:00 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-2338aad0-4bee-4fab-b4ca-5b46e5e6d55e-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Lock "cinder-2338aad0-4bee-4fab-b4ca-5b46e5e6d55e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-1de9d4f9-4996-436e-abc2-6d035fdaac41" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-1de9d4f9-4996-436e-abc2-6d035fdaac41" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-2338aad0-4bee-4fab-b4ca-5b46e5e6d55e" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-2338aad0-4bee-4fab-b4ca-5b46e5e6d55e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Deleting offline snapshot 2338aad0-4bee-4fab-b4ca-5b46e5e6d55e of volume 1de9d4f9-4996-436e-abc2-6d035fdaac41 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:13:00 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] snapshot_file for this snap is: volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf" returned: 0 in 0.499s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab6f757-3959-40d9-b254-063d85de0afb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:00 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf Sep 02 00:13:00 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:00 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e Sep 02 00:13:00 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:00 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba" returned: 0 in 0.321s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076f16b8-aba8-496f-a8bd-4002b16861a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7452fc5d-e363-4327-9a04-226978ab1aba', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e938bdb7-698d-4cf5-8bd2-e3c5d90bcaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Volume volume-7452fc5d-e363-4327-9a04-226978ab1aba (7452fc5d-e363-4327-9a04-226978ab1aba): created successfully Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e938bdb7-698d-4cf5-8bd2-e3c5d90bcaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (97b18020-f10f-4834-ab7e-28e1e84097e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4d3e7ab9-a2d0-4a6e-ad64-22af9fde0724 tempest-ProjectReaderTests-1147775413 None] Created volume successfully. Sep 02 00:13:00 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-d816cd5e-fa9c-4680-9870-edfc5feebfaf" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-d816cd5e-fa9c-4680-9870-edfc5feebfaf" released by "delete_volume" :: held 0.841s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:00 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created reservations ['049c06fb-91fe-477e-b787-c08db587b5a1', '10f6f70e-b6d6-480d-9d6e-409736ad3efb', 'ca0717c6-dfd4-470e-9ee1-048819748d2f', '8389fd2e-833a-4517-ab58-998c48d792e5'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:01 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:01 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:01 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de9d4f9-4996-436e-abc2-6d035fdaac41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f0981f-cb6e-43ba-ad60-092211bdfca8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-fea82685-877f-4837-8173-922d005a947f-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-fea82685-877f-4837-8173-922d005a947f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:01 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 Sep 02 00:13:01 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-quobyte-fea82685-877f-4837-8173-922d005a947f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-fea82685-877f-4837-8173-922d005a947f" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[934d1269-1a0f-4f38-963b-37051691e455]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:01 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Deleted volume successfully. Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40cac0ab-f54b-4a37-b994-f6e5b917fca8 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-d816cd5e-fa9c-4680-9870-edfc5feebfaf-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:01 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f Sep 02 00:13:01 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Creating offline snapshot b454f44c-b7e7-469e-9a84-1dbaf8b9efbb of volume 7452fc5d-e363-4327-9a04-226978ab1aba {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[49425cb4-2673-458d-aacc-5003c6da998f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:01 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41" returned: 0 in 0.618s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:01 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba Sep 02 00:13:01 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:01 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e Sep 02 00:13:01 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:01 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f" returned: 0 in 0.595s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:02 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f Sep 02 00:13:02 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:02 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:02 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb 1G Sep 02 00:13:02 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:02 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-fea82685-877f-4837-8173-922d005a947f" returned: 0 in 0.303s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:02 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e" returned: 0 in 0.523s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-fea82685-877f-4837-8173-922d005a947f" released by "delete_volume" :: held 0.970s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:02 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e Sep 02 00:13:02 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created reservations ['52dbf7b7-70d8-4c51-bdcb-6f3064ee15b7', '8014aed1-3ae0-4f8e-85aa-2b8b280fccd9', '9f86c8a6-e3eb-4c76-a25d-53f764b29325', '6a2fa226-1353-4b32-a42e-a7734bc18b55'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:02 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:02 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:02 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41.2338aad0-4bee-4fab-b4ca-5b46e5e6d55e" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-2338aad0-4bee-4fab-b4ca-5b46e5e6d55e" released by "_delete_snapshot" :: held 2.087s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-66841275-683b-44e2-a426-f994683135e9-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-1de9d4f9-4996-436e-abc2-6d035fdaac41" released by "delete_snapshot" :: held 2.132s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-66841275-683b-44e2-a426-f994683135e9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-quobyte-66841275-683b-44e2-a426-f994683135e9" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:02 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-66841275-683b-44e2-a426-f994683135e9" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb 1G" returned: 0 in 0.713s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7452fc5d-e363-4327-9a04-226978ab1aba -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:02 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7e5591-c4e8-4efd-ba22-ac5e6bba5839]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:02 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7452fc5d-e363-4327-9a04-226978ab1aba -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb Sep 02 00:13:02 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.409s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Created reservations ['8ba19086-d4d4-46bc-bc3d-51415c00f4d3', 'c8139f9a-0b90-424e-a467-cc5f5e56738c', '28cb96ee-53f3-4c94-b3c4-b50cd66f47a8', 'f8439549-cf9f-48be-9c62-edf4ad27827d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Deleted volume successfully. Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da2de854-6611-4455-9328-bc12c698be34 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-fea82685-877f-4837-8173-922d005a947f-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Delete snapshot completed successfully. Sep 02 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-27461447-4ee7-40c7-af7d-e22b3b574fbf tempest-ProjectMemberTests-204781831 None] Lock "cinder-2338aad0-4bee-4fab-b4ca-5b46e5e6d55e-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:03 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9 Sep 02 00:13:03 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:03 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7452fc5d-e363-4327-9a04-226978ab1aba -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:03 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb is being set with open permissions: ugo+rw Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:03 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb Sep 02 00:13:03 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:03 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9" returned: 0 in 0.406s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:03 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9 Sep 02 00:13:03 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:03 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb" returned: 0 in 0.264s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:03 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.info Sep 02 00:13:03 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:03 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-66841275-683b-44e2-a426-f994683135e9" returned: 0 in 0.278s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-66841275-683b-44e2-a426-f994683135e9" released by "delete_volume" :: held 0.747s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created reservations ['bfaf1031-0b61-4338-b558-e4b711a84deb', 'bef14fd3-c422-4481-b610-afcc4c2e9858', '258ace68-e56b-4a42-b739-9d1c94a9f037', '4d7d9305-1eff-4317-aeca-b0b4e1601131'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:03 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:03 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:03 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.info" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:03 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.info is being set with open permissions: ugo+rw Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:03 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.info Sep 02 00:13:03 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-1de9d4f9-4996-436e-abc2-6d035fdaac41-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Lock "cinder-1de9d4f9-4996-436e-abc2-6d035fdaac41-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-099b4956-e85d-46a7-802e-5c25595996cf-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:04 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.334s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-1de9d4f9-4996-436e-abc2-6d035fdaac41" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Deleted volume successfully. Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-099b4956-e85d-46a7-802e-5c25595996cf-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-1de9d4f9-4996-436e-abc2-6d035fdaac41" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91f38039-e47c-4afd-bc47-3027d1bc4fd5 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-66841275-683b-44e2-a426-f994683135e9-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d3f917-4091-4a0e-a9c3-c6dbc5abe1ff]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "cinder-quobyte-099b4956-e85d-46a7-802e-5c25595996cf" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-099b4956-e85d-46a7-802e-5c25595996cf" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db69b944-cc69-40cb-8762-a74836097462]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:04 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.info" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e6342f9f-75f8-4440-aaa5-ca531b613737 tempest-ProjectReaderTests-1147775413 None] Create snapshot completed successfully Sep 02 00:13:04 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 Sep 02 00:13:04 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:04 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf Sep 02 00:13:04 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:04 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41" returned: 0 in 0.452s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:04 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:04 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41 Sep 02 00:13:04 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:04 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf Sep 02 00:13:04 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-b454f44c-b7e7-469e-9a84-1dbaf8b9efbb-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-b454f44c-b7e7-469e-9a84-1dbaf8b9efbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-7452fc5d-e363-4327-9a04-226978ab1aba" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-7452fc5d-e363-4327-9a04-226978ab1aba" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-b454f44c-b7e7-469e-9a84-1dbaf8b9efbb" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-b454f44c-b7e7-469e-9a84-1dbaf8b9efbb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Deleting offline snapshot b454f44c-b7e7-469e-9a84-1dbaf8b9efbb of volume 7452fc5d-e363-4327-9a04-226978ab1aba {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] snapshot_file for this snap is: volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e88f080-a127-4ed3-b011-052a8917cfda]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:04 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-1de9d4f9-4996-436e-abc2-6d035fdaac41" returned: 0 in 0.334s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:04 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-099b4956-e85d-46a7-802e-5c25595996cf" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-1de9d4f9-4996-436e-abc2-6d035fdaac41" released by "delete_volume" :: held 0.909s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-quobyte-099b4956-e85d-46a7-802e-5c25595996cf" released by "delete_volume" :: held 0.803s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:05 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb Sep 02 00:13:05 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Created reservations ['d28467c3-24fe-4ec6-95f1-e586c4965499', '24cc70a2-deab-4669-b347-cace1c25fbf6', 'a8b13d33-bd08-472a-ba36-6f109071f84f', '3a01ee93-5536-4a19-9f6c-e0a6b5cbf381'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Created reservations ['de2706de-5cc7-4091-837f-a03edcf78e0e', '14044090-cb32-4a3c-be62-7896b39113e2', '08f09e15-a097-477d-bd40-7adec2cd9142', 'f36e7949-dcc6-4f1e-8b53-4c33b0ba78e6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:05 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:05 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:05 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb" returned: 0 in 0.479s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7452fc5d-e363-4327-9a04-226978ab1aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:13:05 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:05 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7379dc-a6a1-4545-be6f-d8a8b757a267]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:05 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba Sep 02 00:13:05 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:05 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:05 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.267s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Deleted volume successfully. Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8b9e9e6-7669-4679-b1bf-dc229f2df144 tempest-CreateVolumesFromSourceVolumeTest-348954834 None] Lock "cinder-099b4956-e85d-46a7-802e-5c25595996cf-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Deleted volume successfully. Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bd73311b-f18e-4734-8384-dca74b2a4ee4 tempest-ProjectMemberTests-204781831 None] Lock "cinder-1de9d4f9-4996-436e-abc2-6d035fdaac41-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:05 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba" returned: 0 in 0.412s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:05 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb Sep 02 00:13:05 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:06 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb" returned: 0 in 0.374s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:06 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb Sep 02 00:13:06 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:06 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba.b454f44c-b7e7-469e-9a84-1dbaf8b9efbb" returned: 0 in 0.340s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:06 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:06 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-b454f44c-b7e7-469e-9a84-1dbaf8b9efbb" released by "_delete_snapshot" :: held 1.743s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-7452fc5d-e363-4327-9a04-226978ab1aba" released by "delete_snapshot" :: held 1.772s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Created reservations ['dea0330b-a53d-4061-973d-ea5bdbd9b0c9', '85030b73-a9ac-41ee-b80f-ff8465037b32', 'cbc48153-fe74-4c1e-ad01-eb3b8de9f53f', 'c9e89fd3-1b2e-4194-a361-32264ce21ec3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (f3087693-4338-48a0-a74f-72b443bc3267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bccde4-aa4f-420f-b516-4d45376609ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bccde4-aa4f-420f-b516-4d45376609ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1759978174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473a3342-d120-4c24-b8ca-a834b558ed83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:07Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667db90d-6a1f-4801-ac3e-3db8b76e90fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667db90d-6a1f-4801-ac3e-3db8b76e90fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7c1e79-dbe8-442d-9686-524067365497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7c1e79-dbe8-442d-9686-524067365497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '473a3342-d120-4c24-b8ca-a834b558ed83', 'volume_name': 'volume-473a3342-d120-4c24-b8ca-a834b558ed83', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d47a40c-df2b-4f38-9be8-eeb8401f6793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d47a40c-df2b-4f38-9be8-eeb8401f6793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe817be-75a4-42fe-b589-cb2b4e1e9a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Volume 473a3342-d120-4c24-b8ca-a834b558ed83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-473a3342-d120-4c24-b8ca-a834b558ed83', 'volume_size': 1} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1759978174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473a3342-d120-4c24-b8ca-a834b558ed83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:07Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Creating volume 473a3342-d120-4c24-b8ca-a834b558ed83 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:06 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-7452fc5d-e363-4327-9a04-226978ab1aba-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Delete snapshot completed successfully. Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-607e6c4c-c4f8-453f-ab98-4b319275a613 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-b454f44c-b7e7-469e-9a84-1dbaf8b9efbb-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:07 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 1073741824 Sep 02 00:13:07 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-7452fc5d-e363-4327-9a04-226978ab1aba-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-7452fc5d-e363-4327-9a04-226978ab1aba" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-7452fc5d-e363-4327-9a04-226978ab1aba" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf5f9ea-a610-41c1-a0be-4b2e10136c3a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:07 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba Sep 02 00:13:07 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:07 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 1073741824" returned: 0 in 0.632s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:07 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba" returned: 0 in 0.475s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:07 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 Sep 02 00:13:07 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:07 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba Sep 02 00:13:07 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:07 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83" returned: 0 in 0.333s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe817be-75a4-42fe-b589-cb2b4e1e9a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-473a3342-d120-4c24-b8ca-a834b558ed83', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918f3da8-8d5b-4768-96fc-de74ec128230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Volume volume-473a3342-d120-4c24-b8ca-a834b558ed83 (473a3342-d120-4c24-b8ca-a834b558ed83): created successfully Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918f3da8-8d5b-4768-96fc-de74ec128230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:08 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (f3087693-4338-48a0-a74f-72b443bc3267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7452fc5d-e363-4327-9a04-226978ab1aba" returned: 0 in 0.356s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-7452fc5d-e363-4327-9a04-226978ab1aba" released by "delete_volume" :: held 0.915s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-76147d43-5325-45f5-aa3a-7001388cc4e4 tempest-ProjectMemberTests-204781831 None] Created volume successfully. Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Created reservations ['5e3d6295-28b8-4cda-b270-071c882b7403', 'ea74d319-2c93-4b76-82e8-7860c18b50b1', '2605ec44-704d-4d44-963c-e8d360885595', '9b7a6899-65e8-47cd-b63f-bc4fde483d4b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:08 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:08 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:08 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Deleted volume successfully. Sep 02 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a8bf1b53-a209-4cd5-a63e-a2848026ec24 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-7452fc5d-e363-4327-9a04-226978ab1aba-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Creating offline snapshot 1b5e1990-35f2-4737-95ed-a07c57e945a0 of volume 473a3342-d120-4c24-b8ca-a834b558ed83 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84a6b58-18dc-40dd-bb4f-59a37bd1e016]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:09 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 Sep 02 00:13:09 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:09 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83" returned: 0 in 0.414s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:09 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 1G Sep 02 00:13:09 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (ae6a40f4-c4d5-4754-abca-405f39bee04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1cab0f-1419-45da-8f97-4c217833b25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1cab0f-1419-45da-8f97-4c217833b25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308849632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea11dcc1-a42f-471c-ab20-d28fd4fee8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:10Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8d0d1f-a145-442e-bc81-4558dcdd53ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8d0d1f-a145-442e-bc81-4558dcdd53ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ed83e3-2cc8-40f6-9736-c743f3c3742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ed83e3-2cc8-40f6-9736-c743f3c3742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea11dcc1-a42f-471c-ab20-d28fd4fee8c7', 'volume_name': 'volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed13f81-e7f0-45ed-a8ff-5c4075b5d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed13f81-e7f0-45ed-a8ff-5c4075b5d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089a87b1-4178-4662-9b74-64eb7a3a186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Volume ea11dcc1-a42f-471c-ab20-d28fd4fee8c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7', 'volume_size': 1} Sep 02 00:13:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:10 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 1G" returned: 0 in 0.580s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-473a3342-d120-4c24-b8ca-a834b558ed83 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:10 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-473a3342-d120-4c24-b8ca-a834b558ed83 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 Sep 02 00:13:10 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:10 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-473a3342-d120-4c24-b8ca-a834b558ed83 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0" returned: 0 in 0.500s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:10 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 is being set with open permissions: ugo+rw Sep 02 00:13:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:10 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 Sep 02 00:13:10 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:10 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0" returned: 0 in 0.317s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:11 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.info Sep 02 00:13:11 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:11 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.info" returned: 0 in 0.271s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:11 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.info is being set with open permissions: ugo+rw Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:11 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.info Sep 02 00:13:11 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:11 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.info" returned: 0 in 0.250s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308849632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea11dcc1-a42f-471c-ab20-d28fd4fee8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:10Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Creating volume ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:11 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:11 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 1073741824 Sep 02 00:13:11 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5f7b541a-c9c2-44e3-b4d5-c4832d4899ef tempest-ProjectMemberTests-204781831 None] Create snapshot completed successfully Sep 02 00:13:11 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 1073741824" returned: 0 in 0.428s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:12 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 Sep 02 00:13:12 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:12 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-1b5e1990-35f2-4737-95ed-a07c57e945a0-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089a87b1-4178-4662-9b74-64eb7a3a186e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945bc013-6f5a-44ab-815b-dba615449b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-1b5e1990-35f2-4737-95ed-a07c57e945a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-473a3342-d120-4c24-b8ca-a834b558ed83" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Volume volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 (ea11dcc1-a42f-471c-ab20-d28fd4fee8c7): created successfully Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945bc013-6f5a-44ab-815b-dba615449b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (ae6a40f4-c4d5-4754-abca-405f39bee04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-473a3342-d120-4c24-b8ca-a834b558ed83" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-1b5e1990-35f2-4737-95ed-a07c57e945a0" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-21336072-fbd2-4bde-b0c4-c561f9734aa2 tempest-ProjectReaderTests-1147775413 None] Created volume successfully. Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-1b5e1990-35f2-4737-95ed-a07c57e945a0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Deleting offline snapshot 1b5e1990-35f2-4737-95ed-a07c57e945a0 of volume 473a3342-d120-4c24-b8ca-a834b558ed83 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] snapshot_file for this snap is: volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bada7a1-c53d-4800-98ae-023d9c108392]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:12 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 Sep 02 00:13:12 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:12 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0" returned: 0 in 0.396s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-473a3342-d120-4c24-b8ca-a834b558ed83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec659520-3941-4318-8a7b-7c63f0e8df2b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:12 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 Sep 02 00:13:12 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:13 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Creating offline snapshot 51cd3af6-29c4-4ea8-8cd5-35507e604469 of volume ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83" returned: 0 in 0.379s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b30a2-d245-48be-97cd-c15131ecfc0f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:13 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 Sep 02 00:13:13 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:13 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 Sep 02 00:13:13 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:13 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0" returned: 0 in 0.351s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:13 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0 Sep 02 00:13:13 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:13 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" returned: 0 in 0.381s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:13 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 1G Sep 02 00:13:13 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:13 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83.1b5e1990-35f2-4737-95ed-a07c57e945a0" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-1b5e1990-35f2-4737-95ed-a07c57e945a0" released by "_delete_snapshot" :: held 1.476s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-473a3342-d120-4c24-b8ca-a834b558ed83" released by "delete_snapshot" :: held 1.506s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:13 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Created reservations ['2bfb85cd-806f-4217-aa6d-73ad4acfbb71', '345c7a0b-7d28-4470-9cad-08f4a976220b', 'd3ca08aa-b21f-47d0-ab7c-541e9f83639b', '7837cfea-6c10-48f6-ac17-0d5e30ad4b5d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Delete snapshot completed successfully. Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4dd9e-2b21-4f2d-b3d6-458604da99f6 tempest-ProjectMemberTests-204781831 None] Lock "cinder-1b5e1990-35f2-4737-95ed-a07c57e945a0-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:14 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 1G" returned: 0 in 0.483s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:14 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 Sep 02 00:13:14 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:14 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:14 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 is being set with open permissions: ugo+rw Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:14 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 Sep 02 00:13:14 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-473a3342-d120-4c24-b8ca-a834b558ed83-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Lock "cinder-473a3342-d120-4c24-b8ca-a834b558ed83-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-473a3342-d120-4c24-b8ca-a834b558ed83" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-473a3342-d120-4c24-b8ca-a834b558ed83" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fd251a-625e-463d-9c59-89f986eddb59]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:14 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 Sep 02 00:13:14 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:14 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469" returned: 0 in 0.345s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:14 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.info Sep 02 00:13:14 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:15 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:15 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83 Sep 02 00:13:15 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:15 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.info" returned: 0 in 0.271s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:15 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.info is being set with open permissions: ugo+rw Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:15 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.info Sep 02 00:13:15 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:15 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-473a3342-d120-4c24-b8ca-a834b558ed83" returned: 0 in 0.270s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-473a3342-d120-4c24-b8ca-a834b558ed83" released by "delete_volume" :: held 0.697s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:15 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.info" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Created reservations ['b267d45b-f9b6-47a1-a37d-3714169de9af', '5f93228f-b88f-4936-bd08-86195abcdae2', 'bfcf9859-af39-4e9f-8851-468b6ea56c98', '0ff60f8c-48c9-4e9e-9753-9a486773a340'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cb1abc4e-64ca-4912-8840-840a6f1dc52d tempest-ProjectReaderTests-1147775413 None] Create snapshot completed successfully Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:15 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:15 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:15 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.252s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Deleted volume successfully. Sep 02 00:13:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16610231-2397-461f-9e02-31e141540c50 tempest-ProjectMemberTests-204781831 None] Lock "cinder-473a3342-d120-4c24-b8ca-a834b558ed83-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (1e09438f-c2bf-4f96-a7ab-24a5697c2b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec42cc8-4ed5-436b-8ad8-eaa64377e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec42cc8-4ed5-436b-8ad8-eaa64377e77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863502774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a359bbef-3d0f-4da2-b8b3-353c71f70af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:16Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7816455f-ceb8-4570-a7dc-8371014e00f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7816455f-ceb8-4570-a7dc-8371014e00f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3fe1dc-e183-4c6d-8083-699f64c01bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3fe1dc-e183-4c6d-8083-699f64c01bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a359bbef-3d0f-4da2-b8b3-353c71f70af3', 'volume_name': 'volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526f915d-347a-4319-a4aa-29899f7ebce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526f915d-347a-4319-a4aa-29899f7ebce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04f7f7a-f83e-4ed8-9971-ca4024ace783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Volume a359bbef-3d0f-4da2-b8b3-353c71f70af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3', 'volume_size': 1} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863502774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a359bbef-3d0f-4da2-b8b3-353c71f70af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:16Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Creating volume a359bbef-3d0f-4da2-b8b3-353c71f70af3 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:16 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:16 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 1073741824 Sep 02 00:13:16 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-51cd3af6-29c4-4ea8-8cd5-35507e604469-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-51cd3af6-29c4-4ea8-8cd5-35507e604469-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-51cd3af6-29c4-4ea8-8cd5-35507e604469" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-51cd3af6-29c4-4ea8-8cd5-35507e604469" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Deleting offline snapshot 51cd3af6-29c4-4ea8-8cd5-35507e604469 of volume ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] snapshot_file for this snap is: volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd670038-f1d2-4428-956e-b51e1c68e23a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:16 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 Sep 02 00:13:16 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:16 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 1073741824" returned: 0 in 0.538s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:16 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 Sep 02 00:13:16 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:16 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469" returned: 0 in 0.433s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d71306-79e9-47dc-9f74-1483d525f91d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:17 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 Sep 02 00:13:17 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:17 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3" returned: 0 in 0.290s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04f7f7a-f83e-4ed8-9971-ca4024ace783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25db7238-e3a7-40a4-a064-6f1d5070da83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Volume volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 (a359bbef-3d0f-4da2-b8b3-353c71f70af3): created successfully Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25db7238-e3a7-40a4-a064-6f1d5070da83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (1e09438f-c2bf-4f96-a7ab-24a5697c2b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c4caee29-6752-4296-9481-064f2362d5fb tempest-ProjectMemberTests-204781831 None] Created volume successfully. Sep 02 00:13:17 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" returned: 0 in 0.415s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:17 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 Sep 02 00:13:17 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:17 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469" returned: 0 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:17 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469 Sep 02 00:13:17 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:18 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7.51cd3af6-29c4-4ea8-8cd5-35507e604469" returned: 0 in 0.245s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-51cd3af6-29c4-4ea8-8cd5-35507e604469" released by "_delete_snapshot" :: held 1.572s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" released by "delete_snapshot" :: held 1.596s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Created reservations ['91f08626-e2b6-43a8-ab8a-4d9ef64af45c', 'e1f5c088-f398-4f8a-88d6-6dceb8cf571f', '62431a94-d2f1-4e63-9435-a33df0d7fe1e', '85e691b3-0d4d-4ba4-8932-dac9fc1a7830'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Delete snapshot completed successfully. Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0e41a5c7-ba58-4c40-b5b5-65609c6f524e tempest-ProjectReaderTests-1147775413 None] Lock "cinder-51cd3af6-29c4-4ea8-8cd5-35507e604469-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Creating offline snapshot 7e748f6f-ffe2-4e57-9900-24212fa82035 of volume a359bbef-3d0f-4da2-b8b3-353c71f70af3 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c164b8-ee37-48ee-9d5f-bc7fa1a7670d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:18 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 Sep 02 00:13:18 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Lock "cinder-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f93a94-5424-4bbc-adf5-2eb33b18cc14]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:18 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 Sep 02 00:13:18 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:18 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3" returned: 0 in 0.398s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:18 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 1G Sep 02 00:13:18 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:19 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" returned: 0 in 0.384s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:19 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7 Sep 02 00:13:19 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:19 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 1G" returned: 0 in 0.412s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:19 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 Sep 02 00:13:19 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:19 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" returned: 0 in 0.260s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7" released by "delete_volume" :: held 0.698s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Created reservations ['beeca17e-239d-4672-b727-4352adafbd5b', '10b628e3-0296-4741-9b25-9154e48a183b', '38959f5f-da11-4254-8fa9-3a6c7abe8d52', '8d339785-428e-4e40-b581-c6adba3f9402'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:19 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:19 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:19 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035" returned: 0 in 0.327s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:19 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 is being set with open permissions: ugo+rw Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:19 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 Sep 02 00:13:19 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:19 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.287s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Deleted volume successfully. Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d51f435-025e-42ba-a205-ee270e86958c tempest-ProjectReaderTests-1147775413 None] Lock "cinder-ea11dcc1-a42f-471c-ab20-d28fd4fee8c7-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:19 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035" returned: 0 in 0.273s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:19 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.info Sep 02 00:13:19 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:20 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.info" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:20 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.info is being set with open permissions: ugo+rw Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:20 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.info Sep 02 00:13:20 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (37c7a48f-4e85-4dcf-9857-c685c6cff326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcb3f2a-3ce6-4ec0-9446-7b6ad2720e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcb3f2a-3ce6-4ec0-9446-7b6ad2720e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862195565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:20Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6063cb9a-01e7-4822-b786-8b468e14b965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6063cb9a-01e7-4822-b786-8b468e14b965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb17874-9c75-4647-a247-f2296814bd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb17874-9c75-4647-a247-f2296814bd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c', 'volume_name': 'volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78824eb9-c66d-43af-a19a-e9cc03e9ee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78824eb9-c66d-43af-a19a-e9cc03e9ee2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d43430-1fba-4c25-9d68-fddfb7d4adbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Volume 5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c', 'volume_size': 1} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:20 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.info" returned: 0 in 0.244s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862195565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542ec86d756c4324968608d10543ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:20Z,use_quota=True,user_id='b66e1657d1e44eab959839f8ca23a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Creating volume 5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:20 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:20 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c 1073741824 Sep 02 00:13:20 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2351d4c2-1067-4a50-9246-b60d776106c9 tempest-ProjectMemberTests-204781831 None] Create snapshot completed successfully Sep 02 00:13:20 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c 1073741824" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:20 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c Sep 02 00:13:20 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:21 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" returned: 0 in 0.237s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d43430-1fba-4c25-9d68-fddfb7d4adbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f02aef-9824-45a7-b525-b76318ecf143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Volume volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c (5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c): created successfully Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f02aef-9824-45a7-b525-b76318ecf143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Flow 'volume_create_manager' (37c7a48f-4e85-4dcf-9857-c685c6cff326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-58cabde0-cc3c-4389-970a-4b4a7ad67180 tempest-ProjectReaderTests-1147775413 None] Created volume successfully. Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Creating offline snapshot 7015218d-8470-4408-8819-b2269f4c52a2 of volume 5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe17114-7e9c-424a-acc7-167c0d9ca502]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:21 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c Sep 02 00:13:21 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-7e748f6f-ffe2-4e57-9900-24212fa82035-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Lock "cinder-7e748f6f-ffe2-4e57-9900-24212fa82035-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-a359bbef-3d0f-4da2-b8b3-353c71f70af3" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-a359bbef-3d0f-4da2-b8b3-353c71f70af3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-7e748f6f-ffe2-4e57-9900-24212fa82035" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-7e748f6f-ffe2-4e57-9900-24212fa82035" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Deleting offline snapshot 7e748f6f-ffe2-4e57-9900-24212fa82035 of volume a359bbef-3d0f-4da2-b8b3-353c71f70af3 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] snapshot_file for this snap is: volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf408b-76fc-4943-8981-bd16cbe56bf1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:21 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 Sep 02 00:13:21 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:21 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" returned: 0 in 0.367s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:21 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 1G Sep 02 00:13:21 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:22 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035" returned: 0 in 0.367s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c13a3a-4cd8-4530-a655-fe1436a38257]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:22 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 Sep 02 00:13:22 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:22 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 1G" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:22 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 Sep 02 00:13:22 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:22 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3" returned: 0 in 0.412s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:22 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 Sep 02 00:13:22 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:22 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2" returned: 0 in 0.298s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:22 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 is being set with open permissions: ugo+rw Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:22 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 Sep 02 00:13:22 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:22 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2" returned: 0 in 0.247s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:22 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:22 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.info Sep 02 00:13:22 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:22 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035 Sep 02 00:13:22 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:23 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.info" returned: 0 in 0.252s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:23 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.info is being set with open permissions: ugo+rw Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:23 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3.7e748f6f-ffe2-4e57-9900-24212fa82035" returned: 0 in 0.241s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:23 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.info Sep 02 00:13:23 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-7e748f6f-ffe2-4e57-9900-24212fa82035" released by "_delete_snapshot" :: held 1.443s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-a359bbef-3d0f-4da2-b8b3-353c71f70af3" released by "delete_snapshot" :: held 1.463s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Created reservations ['56ac964c-5e1e-49ff-b793-d485ae288850', 'c1335bea-227b-4f5e-ac81-2ed7108dadc8', 'b7e4f200-ac65-451d-b9d0-1a5ea83ff55e', '1ceb3474-c5cf-4716-8696-a54f674b9ee6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Delete snapshot completed successfully. Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-96dfa816-d0d4-424a-8247-0c62a1a7ada0 tempest-ProjectMemberTests-204781831 None] Lock "cinder-7e748f6f-ffe2-4e57-9900-24212fa82035-delete_snapshot" released by "delete_snapshot" :: held 1.602s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:23 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.info" returned: 0 in 0.261s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-46d07bf4-0d47-46f3-b37d-58e5afbd65f0 tempest-ProjectReaderTests-1147775413 None] Create snapshot completed successfully Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-7015218d-8470-4408-8819-b2269f4c52a2-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Lock "cinder-7015218d-8470-4408-8819-b2269f4c52a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-7015218d-8470-4408-8819-b2269f4c52a2" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-7015218d-8470-4408-8819-b2269f4c52a2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Deleting offline snapshot 7015218d-8470-4408-8819-b2269f4c52a2 of volume 5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] snapshot_file for this snap is: volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[988381ed-e5f2-46ce-b5a2-b00cde61b473]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:23 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 Sep 02 00:13:23 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-a359bbef-3d0f-4da2-b8b3-353c71f70af3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Lock "cinder-a359bbef-3d0f-4da2-b8b3-353c71f70af3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-a359bbef-3d0f-4da2-b8b3-353c71f70af3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-a359bbef-3d0f-4da2-b8b3-353c71f70af3" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d817681-612c-4b21-8245-adf121bf4444]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:23 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 Sep 02 00:13:23 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:23 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2" returned: 0 in 0.380s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9631951f-4a4e-4fea-8dee-a420ba6d3ffe]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:24 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c Sep 02 00:13:24 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:24 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3" returned: 0 in 0.378s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:24 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3 Sep 02 00:13:24 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:24 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" returned: 0 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:24 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 Sep 02 00:13:24 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:24 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-a359bbef-3d0f-4da2-b8b3-353c71f70af3" returned: 0 in 0.253s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-a359bbef-3d0f-4da2-b8b3-353c71f70af3" released by "delete_volume" :: held 0.684s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Created reservations ['f0844a43-fb9f-45ad-b9e6-30b8764695ee', 'cb42f56d-615b-4e8e-a1a4-83ffcd82b05d', 'ac118395-05db-48d2-b3f8-40764c03f54e', 'cf9ac24b-6a46-432c-9c83-dc24a62d7bb4'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:24 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:24 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:24 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2" returned: 0 in 0.348s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:24 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2 Sep 02 00:13:24 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:24 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.280s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Deleted volume successfully. Sep 02 00:13:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da64c7f5-c5bf-4f14-80ce-24e86e4ace75 tempest-ProjectMemberTests-204781831 None] Lock "cinder-a359bbef-3d0f-4da2-b8b3-353c71f70af3-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:25 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c.7015218d-8470-4408-8819-b2269f4c52a2" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-7015218d-8470-4408-8819-b2269f4c52a2" released by "_delete_snapshot" :: held 1.457s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" released by "delete_snapshot" :: held 1.486s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Created reservations ['3a0af912-f15c-4726-ae8d-0e3507285179', 'c0a5a4d5-73ab-48bf-9130-6fb45b6aa7de', 'b650156e-90d4-4154-9907-b639e513f0b8', '7085501f-4dcb-488c-8b1f-3a79feeb8b7c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Delete snapshot completed successfully. Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ae2645a1-5b5c-419a-85d1-aba89368e11d tempest-ProjectReaderTests-1147775413 None] Lock "cinder-7015218d-8470-4408-8819-b2269f4c52a2-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (948a9b51-04ae-4cd2-8eee-000ff8fa2cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7182995-7dc6-42e8-ab21-b0d2ac8925a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7182995-7dc6-42e8-ab21-b0d2ac8925a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991604339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d7e1fa-8467-47fd-b7b9-29a7c9779636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:25Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c95f4f-46e1-490b-8b13-88f8c4e085ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c95f4f-46e1-490b-8b13-88f8c4e085ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7485c07-fade-4804-b14d-52301af45c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7485c07-fade-4804-b14d-52301af45c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d7e1fa-8467-47fd-b7b9-29a7c9779636', 'volume_name': 'volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b310559-2acb-4cfe-88fe-7c3c47a76e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b310559-2acb-4cfe-88fe-7c3c47a76e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845ba580-58fc-4951-b6ca-f60e098a8d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:25 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Volume 42d7e1fa-8467-47fd-b7b9-29a7c9779636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636', 'volume_size': 1} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991604339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d7e1fa-8467-47fd-b7b9-29a7c9779636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:25Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Creating volume 42d7e1fa-8467-47fd-b7b9-29a7c9779636 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:25 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:25 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 1073741824 Sep 02 00:13:25 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "cinder-quobyte-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[653d14b1-ef4c-4755-9ed2-838cc31446e8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:25 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 1073741824" returned: 0 in 0.448s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:25 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c Sep 02 00:13:25 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:25 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 Sep 02 00:13:25 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:26 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636" returned: 0 in 0.236s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845ba580-58fc-4951-b6ca-f60e098a8d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:26 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc133f0c-7eea-4246-a041-6c4e8ddfe0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" returned: 0 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Volume volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 (42d7e1fa-8467-47fd-b7b9-29a7c9779636): created successfully Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc133f0c-7eea-4246-a041-6c4e8ddfe0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:26 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c Sep 02 00:13:26 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (948a9b51-04ae-4cd2-8eee-000ff8fa2cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-eeeddb8f-47fc-4942-9116-0fc4265d7501 tempest-ProjectMemberTests-204781831 None] Created volume successfully. Sep 02 00:13:26 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" returned: 0 in 0.244s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-quobyte-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c" released by "delete_volume" :: held 0.680s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Created reservations ['041f3509-96aa-4e69-91c1-3dd364513c27', 'ad23f514-5b87-47e7-95b5-5a1f507853ce', '78a7a7c8-9247-4f09-905b-972403b43dea', '253c9d3e-186f-4223-a249-b5eb251dcb3e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Creating offline snapshot 5dd3a2bc-06a1-478a-ad94-c30a40d15c14 of volume 42d7e1fa-8467-47fd-b7b9-29a7c9779636 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be54d05-e831-4857-a354-3dc142d3ead0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:26 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 Sep 02 00:13:26 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:26 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:26 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:26 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Deleted volume successfully. Sep 02 00:13:27 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88011d42-243c-49bd-9c98-ae828c1eda43 tempest-ProjectReaderTests-1147775413 None] Lock "cinder-5f104b0f-cec6-4ab3-b2e0-a9b8a9e42c2c-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:27 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 1G Sep 02 00:13:27 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:27 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 1G" returned: 0 in 0.428s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:27 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 Sep 02 00:13:27 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:27 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14" returned: 0 in 0.302s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:27 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 is being set with open permissions: ugo+rw Sep 02 00:13:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:27 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 Sep 02 00:13:27 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:27 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14" returned: 0 in 0.248s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:28 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.info Sep 02 00:13:28 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:28 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.info" returned: 0 in 0.283s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:28 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.info is being set with open permissions: ugo+rw Sep 02 00:13:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:28 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.info Sep 02 00:13:28 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:28 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.info" returned: 0 in 0.280s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1c4a10b7-ed99-4af5-8fbf-1cc5d6f2d0a0 tempest-ProjectMemberTests-204781831 None] Create snapshot completed successfully Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-5dd3a2bc-06a1-478a-ad94-c30a40d15c14-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Lock "cinder-5dd3a2bc-06a1-478a-ad94-c30a40d15c14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-42d7e1fa-8467-47fd-b7b9-29a7c9779636" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-42d7e1fa-8467-47fd-b7b9-29a7c9779636" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-5dd3a2bc-06a1-478a-ad94-c30a40d15c14" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-5dd3a2bc-06a1-478a-ad94-c30a40d15c14" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Deleting offline snapshot 5dd3a2bc-06a1-478a-ad94-c30a40d15c14 of volume 42d7e1fa-8467-47fd-b7b9-29a7c9779636 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] snapshot_file for this snap is: volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e464759c-7260-4fa3-a284-8871fc4c7762]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:29 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 Sep 02 00:13:29 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:30 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05724c3-24e7-411f-a26f-489bfe2042cb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:30 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 Sep 02 00:13:30 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:30 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636" returned: 0 in 0.373s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:30 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 Sep 02 00:13:30 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Flow 'volume_create_manager' (7a5035e8-307d-4a55-9457-a5e008f0242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f4d55b-4595-476a-a815-704fa24a2412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f4d55b-4595-476a-a815-704fa24a2412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455123625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd07247c-816d-428b-8c92-3478b04d2957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2ae21c6d44ad095f9de46b621a652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:31Z,use_quota=True,user_id='8743b0f6fa9f434888f2fe3ffa694f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6ae67d-29ae-474f-b7ad-3eea95add168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6ae67d-29ae-474f-b7ad-3eea95add168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32a64e2-4602-4ae7-8dca-8bc0c16ea86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32a64e2-4602-4ae7-8dca-8bc0c16ea86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd07247c-816d-428b-8c92-3478b04d2957', 'volume_name': 'volume-cd07247c-816d-428b-8c92-3478b04d2957', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4f9918-713b-4c5f-84d5-debe3d07eb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4f9918-713b-4c5f-84d5-debe3d07eb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e249a8b-c3fc-409d-a07e-dfb0ad5151fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:30 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Volume cd07247c-816d-428b-8c92-3478b04d2957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd07247c-816d-428b-8c92-3478b04d2957', 'volume_size': 1} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455123625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd07247c-816d-428b-8c92-3478b04d2957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2ae21c6d44ad095f9de46b621a652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:31Z,use_quota=True,user_id='8743b0f6fa9f434888f2fe3ffa694f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Creating volume cd07247c-816d-428b-8c92-3478b04d2957 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:30 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:30 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957 1073741824 Sep 02 00:13:30 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:30 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14" returned: 0 in 0.344s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:30 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14 Sep 02 00:13:30 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:31 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636.5dd3a2bc-06a1-478a-ad94-c30a40d15c14" returned: 0 in 0.280s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-5dd3a2bc-06a1-478a-ad94-c30a40d15c14" released by "_delete_snapshot" :: held 1.456s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-42d7e1fa-8467-47fd-b7b9-29a7c9779636" released by "delete_snapshot" :: held 1.479s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:31 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Created reservations ['e0fc3a4b-90c5-424b-9509-fb5c850b363d', '48286abd-10c3-4d6e-afaf-a0c496bb6293', 'b5910868-48bd-49c2-b0c1-e6a8d1c9a156', 'ae37d6a6-d6f5-4d4e-bf72-85490b1d1184'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957 1073741824" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Delete snapshot completed successfully. Sep 02 00:13:31 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957 Sep 02 00:13:31 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dad3087f-384a-41d1-8a41-71cbb74aa72f tempest-ProjectMemberTests-204781831 None] Lock "cinder-5dd3a2bc-06a1-478a-ad94-c30a40d15c14-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:31 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957" returned: 0 in 0.273s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e249a8b-c3fc-409d-a07e-dfb0ad5151fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd07247c-816d-428b-8c92-3478b04d2957', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9719a08-94ae-4335-8655-348533af8e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:31 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Volume volume-cd07247c-816d-428b-8c92-3478b04d2957 (cd07247c-816d-428b-8c92-3478b04d2957): created successfully Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9719a08-94ae-4335-8655-348533af8e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Flow 'volume_create_manager' (7a5035e8-307d-4a55-9457-a5e008f0242c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dc40a57c-c5be-4d55-9f13-84706d0b6419 tempest-ProjectReaderTests-1533743030 None] Created volume successfully. Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-42d7e1fa-8467-47fd-b7b9-29a7c9779636-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Lock "cinder-42d7e1fa-8467-47fd-b7b9-29a7c9779636-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-42d7e1fa-8467-47fd-b7b9-29a7c9779636" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-42d7e1fa-8467-47fd-b7b9-29a7c9779636" acquired by "delete_volume" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ccfed9-c652-413b-8bd9-b264b4baa47a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:32 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 Sep 02 00:13:32 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:32 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636" returned: 0 in 0.348s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:32 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636 Sep 02 00:13:32 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:32 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-42d7e1fa-8467-47fd-b7b9-29a7c9779636" returned: 0 in 0.247s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-42d7e1fa-8467-47fd-b7b9-29a7c9779636" released by "delete_volume" :: held 0.648s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Created reservations ['be97a405-5a4a-4afd-af22-b44d88e41b53', 'c80717be-31b1-4eb4-9153-1d7f9c418f0b', '59a530d8-8b59-4f12-af27-d3be297b60e4', '2e6bf245-b6fb-4c0c-b8fb-4175846e087c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:32 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:32 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:32 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.258s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Deleted volume successfully. Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-947ace04-1460-401e-be6f-e1b473d599ca tempest-ProjectMemberTests-204781831 None] Lock "cinder-42d7e1fa-8467-47fd-b7b9-29a7c9779636-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "cinder-cd07247c-816d-428b-8c92-3478b04d2957-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Lock "cinder-cd07247c-816d-428b-8c92-3478b04d2957-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "cinder-quobyte-cd07247c-816d-428b-8c92-3478b04d2957" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Lock "cinder-quobyte-cd07247c-816d-428b-8c92-3478b04d2957" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[123dc5d5-a5aa-4dfb-981d-ad2f6db02225]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:33 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957 Sep 02 00:13:33 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:33 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957" returned: 0 in 0.391s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:33 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957 Sep 02 00:13:33 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (e1acae45-9b0b-43a6-926c-21f05f13bfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77259afd-3df5-4fa6-8f44-a816fc6bedb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77259afd-3df5-4fa6-8f44-a816fc6bedb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447311268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60b1c04-9ea5-4bc6-8425-84ecdb8551bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:33Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3c39e4-19fd-4004-b928-f03eca607954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3c39e4-19fd-4004-b928-f03eca607954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb95a9ca-a660-4f19-9d20-6dc8ed3709f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb95a9ca-a660-4f19-9d20-6dc8ed3709f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b60b1c04-9ea5-4bc6-8425-84ecdb8551bc', 'volume_name': 'volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a57c13-bc48-4545-a498-85fb34d907d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a57c13-bc48-4545-a498-85fb34d907d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c64ce1e-3ca4-40d3-be53-42d3b6be23c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Volume b60b1c04-9ea5-4bc6-8425-84ecdb8551bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc', 'volume_size': 1} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447311268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60b1c04-9ea5-4bc6-8425-84ecdb8551bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857d67db48284580b45ae5fbf7ddb498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:33Z,use_quota=True,user_id='98d99f9756ae4008a8426e0ab0812856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Creating volume b60b1c04-9ea5-4bc6-8425-84ecdb8551bc {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:33 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:33 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc 1073741824 Sep 02 00:13:33 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:33 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-cd07247c-816d-428b-8c92-3478b04d2957" returned: 0 in 0.243s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Lock "cinder-quobyte-cd07247c-816d-428b-8c92-3478b04d2957" released by "delete_volume" :: held 0.672s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Created reservations ['bf4472e2-c0f4-463c-87cd-285d16ebd5a7', '4f5b771a-4b60-4168-86ee-15c9e9239f07', '9360fd6d-2a02-4665-85c2-34e1dc95724d', '8197597a-da5c-4133-bf62-805103261837'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:33 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:33 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:34 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc 1073741824" returned: 0 in 0.427s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:34 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc Sep 02 00:13:34 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:34 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.267s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Deleted volume successfully. Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0851fced-382d-4d81-8576-7d3e3655a481 tempest-ProjectReaderTests-1533743030 None] Lock "cinder-cd07247c-816d-428b-8c92-3478b04d2957-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:34 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c64ce1e-3ca4-40d3-be53-42d3b6be23c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f71b7c-67a0-451c-bd3a-a0d4e8459530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Volume volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc (b60b1c04-9ea5-4bc6-8425-84ecdb8551bc): created successfully Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f71b7c-67a0-451c-bd3a-a0d4e8459530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Flow 'volume_create_manager' (e1acae45-9b0b-43a6-926c-21f05f13bfa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-28a4e795-bfc6-4455-8ea1-11f5e7953d58 tempest-ProjectMemberTests-204781831 None] Created volume successfully. Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Flow 'volume_create_manager' (023e6436-19a9-49de-95b2-2eae2d4b8020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095ccb59-b737-40e3-bb99-22d9bd2a4ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095ccb59-b737-40e3-bb99-22d9bd2a4ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987610016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b871c7-cd20-4ee4-9ae6-d06293f59b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2ae21c6d44ad095f9de46b621a652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:35Z,use_quota=True,user_id='8743b0f6fa9f434888f2fe3ffa694f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88936b42-c3bf-4dfa-8e14-5a03818e22be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88936b42-c3bf-4dfa-8e14-5a03818e22be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c68e2a-06e2-425e-9404-34301bfe4ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c68e2a-06e2-425e-9404-34301bfe4ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b871c7-cd20-4ee4-9ae6-d06293f59b8c', 'volume_name': 'volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f301986-cef4-4f71-a913-db2872e2b978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f301986-cef4-4f71-a913-db2872e2b978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193d91ea-d4e9-4094-9d26-9f50e0d577db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Volume 09b871c7-cd20-4ee4-9ae6-d06293f59b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c', 'volume_size': 1} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987610016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b871c7-cd20-4ee4-9ae6-d06293f59b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2ae21c6d44ad095f9de46b621a652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:35Z,use_quota=True,user_id='8743b0f6fa9f434888f2fe3ffa694f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Creating volume 09b871c7-cd20-4ee4-9ae6-d06293f59b8c {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:34 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:34 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c 1073741824 Sep 02 00:13:34 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:35 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c 1073741824" returned: 0 in 0.412s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:35 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c Sep 02 00:13:35 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:35 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c" returned: 0 in 0.241s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.657s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193d91ea-d4e9-4094-9d26-9f50e0d577db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c3e0b8-18cf-469c-b9d3-8ecc8cd8bbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Creating offline snapshot 13662cc2-bfc7-4147-87cb-ef7fc520db94 of volume b60b1c04-9ea5-4bc6-8425-84ecdb8551bc {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:13:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Volume volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c (09b871c7-cd20-4ee4-9ae6-d06293f59b8c): created successfully Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c3e0b8-18cf-469c-b9d3-8ecc8cd8bbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Flow 'volume_create_manager' (023e6436-19a9-49de-95b2-2eae2d4b8020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28dc7c-c3dc-453d-9f22-0e95bba89529]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3e353fa7-bdd6-4360-a9ff-b967579f220e tempest-ProjectReaderTests-1533743030 None] Created volume successfully. Sep 02 00:13:35 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc Sep 02 00:13:35 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "cinder-09b871c7-cd20-4ee4-9ae6-d06293f59b8c-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Lock "cinder-09b871c7-cd20-4ee4-9ae6-d06293f59b8c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "cinder-quobyte-09b871c7-cd20-4ee4-9ae6-d06293f59b8c" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Lock "cinder-quobyte-09b871c7-cd20-4ee4-9ae6-d06293f59b8c" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa69b818-8ee1-4b66-93f1-83d2d3d58cb0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:35 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" returned: 0 in 0.385s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:35 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 1G Sep 02 00:13:35 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:35 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c Sep 02 00:13:35 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:36 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c" returned: 0 in 0.373s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:36 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c Sep 02 00:13:36 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:36 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 1G" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:36 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 Sep 02 00:13:36 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:36 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-09b871c7-cd20-4ee4-9ae6-d06293f59b8c" returned: 0 in 0.267s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Lock "cinder-quobyte-09b871c7-cd20-4ee4-9ae6-d06293f59b8c" released by "delete_volume" :: held 0.684s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Created reservations ['993e0914-20db-4c46-9e03-abbd0a6da849', '803a16c7-76a2-4b40-9970-3e4cdf90d559', '592d9bed-4ac1-4f5f-916c-82fd98edddba', 'e84a0b9e-b6cf-4063-9f80-f99810b211f3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:36 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94" returned: 0 in 0.316s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:36 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 is being set with open permissions: ugo+rw Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:36 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:36 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:36 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 Sep 02 00:13:36 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:36 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.262s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Deleted volume successfully. Sep 02 00:13:36 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-48445ea4-deeb-409d-918c-e130bb3e6e45 tempest-ProjectReaderTests-1533743030 None] Lock "cinder-09b871c7-cd20-4ee4-9ae6-d06293f59b8c-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94" returned: 0 in 0.283s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:36 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.info Sep 02 00:13:36 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:37 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.info" returned: 0 in 0.292s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:37 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.info is being set with open permissions: ugo+rw Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:37 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.info Sep 02 00:13:37 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Flow 'volume_create_manager' (0ab25209-edb6-4909-8286-83116bcc8923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3df8ce0-8736-41ca-a201-3251ef0a3bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3df8ce0-8736-41ca-a201-3251ef0a3bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280575326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fdf0356-9c95-4936-89fe-d98cbf27b897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2ae21c6d44ad095f9de46b621a652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:37Z,use_quota=True,user_id='8743b0f6fa9f434888f2fe3ffa694f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7806365d-6e7c-43c8-9e4a-9d3f7978d364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7806365d-6e7c-43c8-9e4a-9d3f7978d364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13e67a1-ab1b-4fc3-84a8-9389a17d4b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13e67a1-ab1b-4fc3-84a8-9389a17d4b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fdf0356-9c95-4936-89fe-d98cbf27b897', 'volume_name': 'volume-3fdf0356-9c95-4936-89fe-d98cbf27b897', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324d656d-408a-4370-b1d4-ce1868f9a9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324d656d-408a-4370-b1d4-ce1868f9a9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d39694-a0de-4a3b-892b-1b7f7bf5543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Volume 3fdf0356-9c95-4936-89fe-d98cbf27b897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fdf0356-9c95-4936-89fe-d98cbf27b897', 'volume_size': 1} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:37 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.info" returned: 0 in 0.251s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280575326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fdf0356-9c95-4936-89fe-d98cbf27b897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2ae21c6d44ad095f9de46b621a652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:37Z,use_quota=True,user_id='8743b0f6fa9f434888f2fe3ffa694f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Creating volume 3fdf0356-9c95-4936-89fe-d98cbf27b897 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:37 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:37 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 1073741824 Sep 02 00:13:37 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-64be8b12-e521-4b3c-a6fb-dafe7c5b451e tempest-ProjectMemberTests-204781831 None] Create snapshot completed successfully Sep 02 00:13:37 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 1073741824" returned: 0 in 0.457s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-13662cc2-bfc7-4147-87cb-ef7fc520db94-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:37 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 Sep 02 00:13:37 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Lock "cinder-13662cc2-bfc7-4147-87cb-ef7fc520db94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-13662cc2-bfc7-4147-87cb-ef7fc520db94" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-13662cc2-bfc7-4147-87cb-ef7fc520db94" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Deleting offline snapshot 13662cc2-bfc7-4147-87cb-ef7fc520db94 of volume b60b1c04-9ea5-4bc6-8425-84ecdb8551bc {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] snapshot_file for this snap is: volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b4d5d4-d496-4e3c-9b68-78269489cf87]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:38 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 Sep 02 00:13:38 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:38 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897" returned: 0 in 0.273s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d39694-a0de-4a3b-892b-1b7f7bf5543f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fdf0356-9c95-4936-89fe-d98cbf27b897', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cdef07-0d28-4bff-ae27-bbf10f2e3cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Volume volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 (3fdf0356-9c95-4936-89fe-d98cbf27b897): created successfully Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cdef07-0d28-4bff-ae27-bbf10f2e3cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Flow 'volume_create_manager' (0ab25209-edb6-4909-8286-83116bcc8923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-07ee7051-b4ba-4cf1-b50a-256fb0fddc53 tempest-ProjectReaderTests-1533743030 None] Created volume successfully. Sep 02 00:13:38 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94" returned: 0 in 0.373s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[846f79da-6274-4bf0-a553-8fc417b42a96]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:38 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc Sep 02 00:13:38 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:38 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:38 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 Sep 02 00:13:38 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:39 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94" returned: 0 in 0.313s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:39 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94 Sep 02 00:13:39 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:39 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc.13662cc2-bfc7-4147-87cb-ef7fc520db94" returned: 0 in 0.237s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-13662cc2-bfc7-4147-87cb-ef7fc520db94" released by "_delete_snapshot" :: held 1.359s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" released by "delete_snapshot" :: held 1.380s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Created reservations ['67561cdd-5210-49b1-b628-92d176711618', 'b555a329-b1de-463d-a2c6-7420d41813df', 'a2b6f5bb-bf53-4659-9985-f02918fad28a', '28a622a7-481f-448a-ac7a-89da7d75d178'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Acquiring lock "cinder-3fdf0356-9c95-4936-89fe-d98cbf27b897-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Lock "cinder-3fdf0356-9c95-4936-89fe-d98cbf27b897-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Delete snapshot completed successfully. Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c0f8ef67-f1c4-44f0-bd60-8e00ea1e234f tempest-ProjectMemberTests-204781831 None] Lock "cinder-13662cc2-bfc7-4147-87cb-ef7fc520db94-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Acquiring lock "cinder-quobyte-3fdf0356-9c95-4936-89fe-d98cbf27b897" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Lock "cinder-quobyte-3fdf0356-9c95-4936-89fe-d98cbf27b897" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa4f8d2-cb4d-43fe-9dce-2a099ab7b002]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:39 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 Sep 02 00:13:39 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:39 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897" returned: 0 in 0.345s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:39 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897 Sep 02 00:13:39 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Lock "cinder-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:40 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-3fdf0356-9c95-4936-89fe-d98cbf27b897" returned: 0 in 0.260s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Acquiring lock "cinder-quobyte-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Lock "cinder-quobyte-3fdf0356-9c95-4936-89fe-d98cbf27b897" released by "delete_volume" :: held 0.643s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcda589c-2a6f-4be6-bb2e-1dfd0fcc4ac8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Created reservations ['641dc308-5d1b-4f99-98dc-d743717cd873', 'b75e47ce-1d22-467a-a7f5-7e1e75b323d4', '1f6508ff-fce9-42be-9ad0-c15d79f1c3b8', 'b582249f-eceb-4607-8352-95530267beab'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:40 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc Sep 02 00:13:40 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:40 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:40 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:40 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.254s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Deleted volume successfully. Sep 02 00:13:40 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2e489f82-47ff-4888-b1a0-225a6f2c255e tempest-ProjectReaderTests-1533743030 None] Lock "cinder-3fdf0356-9c95-4936-89fe-d98cbf27b897-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" returned: 0 in 0.389s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:40 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc Sep 02 00:13:40 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:40 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Lock "cinder-quobyte-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc" released by "delete_volume" :: held 0.731s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Created reservations ['5fe1779f-5cfa-43f8-872c-f9eff359209b', 'd1f09c36-1e0e-48e8-9162-1a976af3cace', '08b895cc-3759-4697-91e9-d6a2f3befc55', '46c0e944-6231-4cdc-9551-ea7b2c40a7fc'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:41 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:41 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Flow 'volume_create_manager' (6788b644-a81a-4c0a-99ec-dec9bc75f437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179ccaf6-2359-4103-b18e-427aa47fcb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179ccaf6-2359-4103-b18e-427aa47fcb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131976084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d63fa29-4f3d-4f34-b673-0e9e93c9ac99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2ae21c6d44ad095f9de46b621a652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:41Z,use_quota=True,user_id='8743b0f6fa9f434888f2fe3ffa694f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee392806-9fb1-41c1-9001-0a81680716dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee392806-9fb1-41c1-9001-0a81680716dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f00a88d-ffff-4cc1-b8f2-c2d44b3976e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f00a88d-ffff-4cc1-b8f2-c2d44b3976e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d63fa29-4f3d-4f34-b673-0e9e93c9ac99', 'volume_name': 'volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac4afab-5ef3-4dca-a214-a3343c3e2baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac4afab-5ef3-4dca-a214-a3343c3e2baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738b61cf-83aa-42ca-b99c-112455b0f1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Volume 7d63fa29-4f3d-4f34-b673-0e9e93c9ac99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99', 'volume_size': 1} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131976084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d63fa29-4f3d-4f34-b673-0e9e93c9ac99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2ae21c6d44ad095f9de46b621a652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:41Z,use_quota=True,user_id='8743b0f6fa9f434888f2fe3ffa694f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Creating volume 7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:41 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:41 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 1073741824 Sep 02 00:13:41 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:41 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Deleted volume successfully. Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0182102f-c542-4e95-8fa0-06fb07e7193e tempest-ProjectMemberTests-204781831 None] Lock "cinder-b60b1c04-9ea5-4bc6-8425-84ecdb8551bc-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:41 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 1073741824" returned: 0 in 0.445s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:41 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 Sep 02 00:13:41 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:41 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99" returned: 0 in 0.250s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738b61cf-83aa-42ca-b99c-112455b0f1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73757dc-d2e5-422f-bbd1-0123743b1d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Volume volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 (7d63fa29-4f3d-4f34-b673-0e9e93c9ac99): created successfully Sep 02 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73757dc-d2e5-422f-bbd1-0123743b1d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Flow 'volume_create_manager' (6788b644-a81a-4c0a-99ec-dec9bc75f437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-71fb8b9b-a9f0-4493-be23-f0e82b3aefef tempest-ProjectReaderTests-1533743030 None] Created volume successfully. Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Acquiring lock "cinder-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Lock "cinder-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Acquiring lock "cinder-quobyte-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Lock "cinder-quobyte-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f94f4e0-50ea-4ce3-a4ca-af6e2b97021c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:42 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 Sep 02 00:13:42 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:42 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99" returned: 0 in 0.375s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:42 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99 Sep 02 00:13:42 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:42 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99" returned: 0 in 0.265s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Lock "cinder-quobyte-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99" released by "delete_volume" :: held 0.685s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Created reservations ['bbdd9332-a965-40dc-aeb0-26a8a207690c', 'dcdb17c5-69ff-404e-8f96-9108e86f3d67', 'be69bca1-af26-4482-b160-f1ff15d09b32', '39bd18a3-2153-4e69-8bec-d04a4a9b006c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:43 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:43 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:43 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.266s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Deleted volume successfully. Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=232,cinder:INSERT=71,cinder:UPDATE=295,cinder:DELETE=29 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-880f2759-e06e-4ed2-9323-02d504843afe tempest-ProjectReaderTests-1533743030 None] Lock "cinder-7d63fa29-4f3d-4f34-b673-0e9e93c9ac99-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:51 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=307,cinder:DELETE=22,cinder:SELECT=204,cinder:INSERT=86 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Flow 'volume_create_manager' (914a501d-88a7-4957-b573-a63473f7a8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ace390-53ae-493d-b65c-9eeaab031652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ace390-53ae-493d-b65c-9eeaab031652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452174131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fbc904-010e-40ff-832b-33f6f8fdb61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f19a584022447629174102d102fafe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:52Z,use_quota=True,user_id='3227faa1f34b490a8f6f3a069a49e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc5eb31-71bb-47a5-badb-e5e9e14d0e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc5eb31-71bb-47a5-badb-e5e9e14d0e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50539d5b-eb50-4636-9cad-8ae8b3a35d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50539d5b-eb50-4636-9cad-8ae8b3a35d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96fbc904-010e-40ff-832b-33f6f8fdb61b', 'volume_name': 'volume-96fbc904-010e-40ff-832b-33f6f8fdb61b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad085137-e563-4946-8995-e561fd51748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad085137-e563-4946-8995-e561fd51748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbfcbb3-15a1-43f0-95cd-20790baede7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Volume 96fbc904-010e-40ff-832b-33f6f8fdb61b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96fbc904-010e-40ff-832b-33f6f8fdb61b', 'volume_size': 1} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452174131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fbc904-010e-40ff-832b-33f6f8fdb61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f19a584022447629174102d102fafe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:52Z,use_quota=True,user_id='3227faa1f34b490a8f6f3a069a49e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Creating volume 96fbc904-010e-40ff-832b-33f6f8fdb61b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:52 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:52 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b 1073741824 Sep 02 00:13:52 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:52 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b 1073741824" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:52 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b Sep 02 00:13:52 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:52 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b" returned: 0 in 0.250s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbfcbb3-15a1-43f0-95cd-20790baede7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96fbc904-010e-40ff-832b-33f6f8fdb61b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d53509-fcab-477f-8ecc-a09202675759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Volume volume-96fbc904-010e-40ff-832b-33f6f8fdb61b (96fbc904-010e-40ff-832b-33f6f8fdb61b): created successfully Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d53509-fcab-477f-8ecc-a09202675759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Flow 'volume_create_manager' (914a501d-88a7-4957-b573-a63473f7a8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-875a002a-2584-491f-b752-87c60795c613 tempest-ProjectReaderTests-435827713 None] Created volume successfully. Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Acquiring lock "cinder-96fbc904-010e-40ff-832b-33f6f8fdb61b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Lock "cinder-96fbc904-010e-40ff-832b-33f6f8fdb61b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Acquiring lock "cinder-quobyte-96fbc904-010e-40ff-832b-33f6f8fdb61b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Lock "cinder-quobyte-96fbc904-010e-40ff-832b-33f6f8fdb61b" acquired by "delete_volume" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c698353-5c4f-4648-ba8a-15fa3db83abc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:53 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b Sep 02 00:13:53 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:53 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b" returned: 0 in 0.351s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:53 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b Sep 02 00:13:53 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:53 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-96fbc904-010e-40ff-832b-33f6f8fdb61b" returned: 0 in 0.237s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Lock "cinder-quobyte-96fbc904-010e-40ff-832b-33f6f8fdb61b" released by "delete_volume" :: held 0.623s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Created reservations ['90a93f2e-0c23-4d2f-851d-f2f7bd648d0b', 'd112d94d-bbf3-4b96-8b4d-f9a1725164c3', '1047f3a6-8a60-4e3b-8c42-65d2a1ea5ac5', '7027e193-d304-4a1d-a8cb-aaf3a4c911f2'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:54 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:54 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:54 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.233s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Deleted volume successfully. Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1c941abd-02ee-441d-b0ea-1ebb80dc5d90 tempest-ProjectReaderTests-435827713 None] Lock "cinder-96fbc904-010e-40ff-832b-33f6f8fdb61b-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Flow 'volume_create_manager' (0bb82b8a-579a-4ffe-9981-66a8b1b1cbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057d3116-9ff2-49c2-b664-4045130f8dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057d3116-9ff2-49c2-b664-4045130f8dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805036738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf943df-4ccd-4f76-89f8-c98293364763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f19a584022447629174102d102fafe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:55Z,use_quota=True,user_id='3227faa1f34b490a8f6f3a069a49e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8266c80-4478-48f3-840d-9adb8c2bcabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8266c80-4478-48f3-840d-9adb8c2bcabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea96b97a-2445-4d5d-ba69-f0ad73175efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea96b97a-2445-4d5d-ba69-f0ad73175efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf943df-4ccd-4f76-89f8-c98293364763', 'volume_name': 'volume-ddf943df-4ccd-4f76-89f8-c98293364763', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568a09bc-4e20-4143-8086-8e702dbafb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568a09bc-4e20-4143-8086-8e702dbafb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65415d16-4627-417f-aff4-779c48b5b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Volume ddf943df-4ccd-4f76-89f8-c98293364763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf943df-4ccd-4f76-89f8-c98293364763', 'volume_size': 1} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805036738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf943df-4ccd-4f76-89f8-c98293364763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f19a584022447629174102d102fafe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:13:55Z,use_quota=True,user_id='3227faa1f34b490a8f6f3a069a49e4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Creating volume ddf943df-4ccd-4f76-89f8-c98293364763 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:13:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:54 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763 1073741824 Sep 02 00:13:54 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:55 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763 1073741824" returned: 0 in 0.377s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:55 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763 Sep 02 00:13:55 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:55 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763" returned: 0 in 0.234s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] <== create_volume: return (649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.651s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65415d16-4627-417f-aff4-779c48b5b244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf943df-4ccd-4f76-89f8-c98293364763', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b7abf7-fc7c-4d5c-877c-7e911abddd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:13:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Volume volume-ddf943df-4ccd-4f76-89f8-c98293364763 (ddf943df-4ccd-4f76-89f8-c98293364763): created successfully Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b7abf7-fc7c-4d5c-877c-7e911abddd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Flow 'volume_create_manager' (0bb82b8a-579a-4ffe-9981-66a8b1b1cbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:13:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f9a54a61-2661-4f06-853a-9bafdb3a8a9d tempest-ProjectReaderTests-435827713 None] Created volume successfully. Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Acquiring lock "cinder-ddf943df-4ccd-4f76-89f8-c98293364763-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Lock "cinder-ddf943df-4ccd-4f76-89f8-c98293364763-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Acquiring lock "cinder-quobyte-ddf943df-4ccd-4f76-89f8-c98293364763" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Lock "cinder-quobyte-ddf943df-4ccd-4f76-89f8-c98293364763" acquired by "delete_volume" :: waited 0.012s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b34e92-1546-4ad3-b457-d65a4530d1f3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:55 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763 Sep 02 00:13:56 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:56 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:56 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763 Sep 02 00:13:56 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:56 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddf943df-4ccd-4f76-89f8-c98293364763" returned: 0 in 0.235s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Lock "cinder-quobyte-ddf943df-4ccd-4f76-89f8-c98293364763" released by "delete_volume" :: held 0.602s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Created reservations ['c83106cc-d0c0-478a-ba3a-1190520372a4', '684186a7-05bc-44e7-b4a1-4c649dd9dfca', '5bdfd445-7dce-4603-b5a6-1757ecb34e65', 'da8feccb-c2e4-4aa7-aac4-5c7e3f2915f6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:13:56 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:13:56 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:13:56 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.234s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:13:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Deleted volume successfully. Sep 02 00:13:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2aed60af-7985-47f6-b13e-c4a5a2325beb tempest-ProjectReaderTests-435827713 None] Lock "cinder-ddf943df-4ccd-4f76-89f8-c98293364763-delete_volume" released by "delete_volume" :: held 1.008s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:06 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:14:06 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=23,cinder:SELECT=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:14:06 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.337s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:14:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5862613-1ed1-4349-9735-3e32e626223b None None] thread info: [<_MainThread(MainThread, started 129164278538368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Flow 'volume_create_manager' (6c68f4e7-7cb7-4474-9f53-1968cfdf2220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9afa92e-294e-44a4-bccc-7d25c344a933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9afa92e-294e-44a4-bccc-7d25c344a933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-564551956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c891323c-2383-493a-b84e-e00cf676fae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b7db635e91449aaa7d9378e6cdc84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:14:19Z,use_quota=True,user_id='a1cdde1632314a66a4e0fd0a2abb206d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b9061f-c410-4125-bbd8-186110ff2810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b9061f-c410-4125-bbd8-186110ff2810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a908d20e-2e47-4fd7-845f-660d65eee048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a908d20e-2e47-4fd7-845f-660d65eee048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c891323c-2383-493a-b84e-e00cf676fae3', 'volume_name': 'volume-c891323c-2383-493a-b84e-e00cf676fae3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9dede22-db5e-4116-8262-ee90ee29b89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9dede22-db5e-4116-8262-ee90ee29b89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df5f456-1f2f-4b31-b6d5-52821efce5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Volume c891323c-2383-493a-b84e-e00cf676fae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c891323c-2383-493a-b84e-e00cf676fae3', 'volume_size': 1} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-564551956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c891323c-2383-493a-b84e-e00cf676fae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b7db635e91449aaa7d9378e6cdc84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:14:19Z,use_quota=True,user_id='a1cdde1632314a66a4e0fd0a2abb206d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Creating volume c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:14:19 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:19 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 1073741824 Sep 02 00:14:19 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:19 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 1073741824" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:19 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 Sep 02 00:14:19 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:19 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3" returned: 0 in 0.231s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df5f456-1f2f-4b31-b6d5-52821efce5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c891323c-2383-493a-b84e-e00cf676fae3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc053c4-e848-4d9c-99a0-82f01ddd0c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Volume volume-c891323c-2383-493a-b84e-e00cf676fae3 (c891323c-2383-493a-b84e-e00cf676fae3): created successfully Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc053c4-e848-4d9c-99a0-82f01ddd0c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Flow 'volume_create_manager' (6c68f4e7-7cb7-4474-9f53-1968cfdf2220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:14:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5f7e8ffe-18cf-4dde-b48f-9e1e320d2325 tempest-SnapshotDependencyTests-128637502 None] Created volume successfully. Sep 02 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:14:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Creating offline snapshot 031bb432-8a3b-4c8d-abee-11e03300fac8 of volume c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:14:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[236edd66-6ca4-4b24-b22c-94b5e06733de]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:20 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 Sep 02 00:14:20 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:20 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:20 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 1G Sep 02 00:14:20 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:20 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 1G" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c891323c-2383-493a-b84e-e00cf676fae3 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:20 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c891323c-2383-493a-b84e-e00cf676fae3 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 Sep 02 00:14:20 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:21 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c891323c-2383-493a-b84e-e00cf676fae3 -F qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:21 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 is being set with open permissions: ugo+rw Sep 02 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:21 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 Sep 02 00:14:21 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:21 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8" returned: 0 in 0.234s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:21 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.info Sep 02 00:14:21 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:21 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.info" returned: 0 in 0.235s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:21 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.info is being set with open permissions: ugo+rw Sep 02 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:21 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.info Sep 02 00:14:21 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:21 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.info" returned: 0 in 0.242s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:14:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-266d6437-3c08-4827-9a70-3282ea24c1f9 tempest-SnapshotDependencyTests-128637502 None] Create snapshot completed successfully Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Flow 'volume_create_manager' (ffe57313-0d00-4c1a-b741-e5398816ace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb70126-963f-465f-acea-12a86290ebe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb70126-963f-465f-acea-12a86290ebe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddaf3aa0-a3a2-4e2d-912e-189998a64a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b7db635e91449aaa7d9378e6cdc84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=031bb432-8a3b-4c8d-abee-11e03300fac8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:14:23Z,use_quota=True,user_id='a1cdde1632314a66a4e0fd0a2abb206d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd),volume_type_id=11ac6ed8-52c6-49a4-8c7b-ca9ab0e799fd)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25b7763-055a-49e8-8bb7-4c51956ebcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25b7763-055a-49e8-8bb7-4c51956ebcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0417cf88-3ea7-4a61-937e-fcede2e2abd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0417cf88-3ea7-4a61-937e-fcede2e2abd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ddaf3aa0-a3a2-4e2d-912e-189998a64a1b', 'volume_name': 'volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b', 'volume_size': 1, 'snapshot_id': '031bb432-8a3b-4c8d-abee-11e03300fac8'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49c444d-e39b-4ea9-9561-b5fcb5211eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49c444d-e39b-4ea9-9561-b5fcb5211eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf3df2a-259e-4933-8346-4f23d501f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:22 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Volume ddaf3aa0-a3a2-4e2d-912e-189998a64a1b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b', 'volume_size': 1, 'snapshot_id': '031bb432-8a3b-4c8d-abee-11e03300fac8'} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "cinder-quobyte-031bb432-8a3b-4c8d-abee-11e03300fac8-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-031bb432-8a3b-4c8d-abee-11e03300fac8-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Creating volume ddaf3aa0-a3a2-4e2d-912e-189998a64a1b from snapshot 031bb432-8a3b-4c8d-abee-11e03300fac8 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "cinder-quobyte-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] snapshot: 031bb432-8a3b-4c8d-abee-11e03300fac8, volume: ddaf3aa0-a3a2-4e2d-912e-189998a64a1b, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b747d91c-2306-426f-bfc5-cc415b35acf6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:23 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 Sep 02 00:14:23 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:23 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8" returned: 0 in 0.340s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c891323c-2383-493a-b84e-e00cf676fae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:14:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b498c18-7ecc-4cdd-8945-4f9819e3f5f1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:23 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 Sep 02 00:14:23 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:23 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3" returned: 0 in 0.348s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:14:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:14:23 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Path /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:23 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b Sep 02 00:14:23 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:27 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" returned: 0 in 3.899s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3, size 1024.00 MB, duration 3.90 sec, destination /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:14:27 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Converted 1024.00 MB image at 262.54 MB/s Sep 02 00:14:27 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b is being set with open permissions: ugo+rw Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:27 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b Sep 02 00:14:27 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:27 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" returned: 0 in 0.242s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" released by "_copy_volume_from_snapshot" :: held 4.901s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-031bb432-8a3b-4c8d-abee-11e03300fac8-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" released by "_create_volume_from_snapshot" :: held 4.959s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.971s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf3df2a-259e-4933-8346-4f23d501f013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b', 'volume_size': 1, 'snapshot_id': '031bb432-8a3b-4c8d-abee-11e03300fac8'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b13602-063f-40b4-8c81-5ae362ac8f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:14:27 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Volume volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b (ddaf3aa0-a3a2-4e2d-912e-189998a64a1b): created successfully Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b13602-063f-40b4-8c81-5ae362ac8f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Flow 'volume_create_manager' (ffe57313-0d00-4c1a-b741-e5398816ace4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:14:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d30d2474-9761-497f-9694-91e1c8202552 tempest-SnapshotDependencyTests-128637502 None] Created volume successfully. Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "cinder-031bb432-8a3b-4c8d-abee-11e03300fac8-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-031bb432-8a3b-4c8d-abee-11e03300fac8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "cinder-quobyte-c891323c-2383-493a-b84e-e00cf676fae3" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-c891323c-2383-493a-b84e-e00cf676fae3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "cinder-quobyte-031bb432-8a3b-4c8d-abee-11e03300fac8" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-031bb432-8a3b-4c8d-abee-11e03300fac8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Deleting offline snapshot 031bb432-8a3b-4c8d-abee-11e03300fac8 of volume c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] snapshot_file for this snap is: volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[517e2747-3968-4f67-a35b-4332598d6d1b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:28 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 Sep 02 00:14:28 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:28 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8" returned: 0 in 0.360s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c891323c-2383-493a-b84e-e00cf676fae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d1cd2-c98e-4762-92a0-954a2597d917]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:14:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:28 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 Sep 02 00:14:28 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:29 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3" returned: 0 in 0.526s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:29 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 Sep 02 00:14:29 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:29 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8" returned: 0 in 0.318s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:29 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8 Sep 02 00:14:29 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:29 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3.031bb432-8a3b-4c8d-abee-11e03300fac8" returned: 0 in 0.239s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-031bb432-8a3b-4c8d-abee-11e03300fac8" released by "_delete_snapshot" :: held 1.540s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-c891323c-2383-493a-b84e-e00cf676fae3" released by "delete_snapshot" :: held 1.565s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Created reservations ['06c331c0-bf35-4341-923b-f0a32407f403', '1007be24-9a83-4654-b9f4-aa90ec773c6e', '7e3248c4-7a6c-4383-8202-c0abcd0b302f', '10d80ea5-346d-4b88-8cb3-ac14ccc8fda3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:14:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Delete snapshot completed successfully. Sep 02 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2ab4d554-0d46-4e0e-a70e-e5d62e8f999c tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-031bb432-8a3b-4c8d-abee-11e03300fac8-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "cinder-c891323c-2383-493a-b84e-e00cf676fae3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:14:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-c891323c-2383-493a-b84e-e00cf676fae3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:14:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "cinder-quobyte-c891323c-2383-493a-b84e-e00cf676fae3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:14:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-c891323c-2383-493a-b84e-e00cf676fae3" acquired by "delete_volume" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:14:30 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e789ca3-5f50-4a15-9892-68b6273ec445]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:14:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:30 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 Sep 02 00:14:30 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:30 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:30 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3 Sep 02 00:14:30 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:31 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-c891323c-2383-493a-b84e-e00cf676fae3" returned: 0 in 0.232s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-c891323c-2383-493a-b84e-e00cf676fae3" released by "delete_volume" :: held 0.621s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Created reservations ['1d1e5c35-d6f1-4fea-aa12-ad53e3ac1372', '020719c4-4e2a-48a9-911d-f4da5334e190', 'bcecf92c-114a-451f-8610-6bcd42a0c5aa', 'ebdfb6b9-0ba5-4ec4-92c1-155bc0d2fe44'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:31 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:14:31 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:31 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.247s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:14:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Deleted volume successfully. Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6508328-f81d-402a-8575-e92140499d01 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-c891323c-2383-493a-b84e-e00cf676fae3-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "cinder-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "cinder-quobyte-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a88433-949a-4d59-973d-a25b15c0a97e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:14:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:31 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b Sep 02 00:14:31 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:32 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:32 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b Sep 02 00:14:32 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:32 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed/volume-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" returned: 0 in 0.243s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-quobyte-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b" released by "delete_volume" :: held 0.639s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Created reservations ['6beb87a0-fd3a-4b54-af59-ada1726f176e', 'ba3cb2b7-3f78-4b92-b8d7-d2f69eccd528', 'b2cc22df-fa0d-4b93-90d3-dee85f23d0f9', 'f3abbfde-2578-48a8-a713-7a495f9bb319'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd909c7-f776-4233-9c2b-bafc7e68af3f'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:14:32 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed Sep 02 00:14:32 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:14:32 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e486966c9aa9939edb8c8544174c0ed" returned: 0 in 0.251s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:14:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Deleted volume successfully. Sep 02 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9b505c6-877c-42d3-9166-6a94b6f85742 tempest-SnapshotDependencyTests-128637502 None] Lock "cinder-ddaf3aa0-a3a2-4e2d-912e-189998a64a1b-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:14:42 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=32,cinder:SELECT=24,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:14:42 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}